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(54) Picture signal coding and decoding. 

(57) Picture signal coding and decoding methods 
and apparatus are disclosed which eliminate 
such a situation that, when a coded picture 
signal of a high definition television system is 
thinned out to one half in each of the vertical 
and horizontal directions and displayed on a 
television receiver of a lower definition system, 
the displayed picture does not exhibit smooth 
motion due to the loss of an interlace structure. 
In an encoder, picture element data are proces- 
sed by DOT processing to obtain 8x8 coeffi- 
cient data, and the coefficient data are 
transmitted. In a decoder, of the 8 x 8 coefficient 
data, only 4x4 coefficient data at the left upper 
corner are sampled out and processed by IDCT 
processing to obtain original picture element 
data. In the IDCT processing, those of the 4 x 4 
coefficient data which belong to the fourth row 
are replaced by those of the coefficient data of 
the eighth row of the 8 x 8 coefficient data. 
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This invention relates to picture signal coding and 
decoding methods and picture signal coding and de- 
coding apparatus which may, for example, be used to 
compress and record a high quality picture signal, 
.such as a signal of high definition television (high def- 
inition television (HDTV) signal), onto a recording me- 
dium such as an optical disk, a magneto-optical disk 
or a magnetic tape and subsequently to reproduce, 
decompress and display the thus recorded signal. 

Various picture signal coding apparatus and de- 
coding apparatus are already known, and general 
constructions of exemplary ones of conventional pic- 
ture signal coding and decoding apparatus are shown 
in Figure 21 . Referring to Figure 21 ( a pre-processing 
circuit 1 of the coding apparatus shown receives an 
input picture signal such as, for example, a high def- 
inition television signal and separates the input pic- 
ture signal into a brightness signal component (Y) and 
a colour difference signal component (C). The bright- 
ness signal component is converted from an analog 
signal into a digital signal by an analog to signal (A/D) 
converter 2 and is written into a frame memory 4 once 
while the colour difference signal component is con- 
verted from an analog signal into a digital signal by 
another analog to digital (A/D) converter 3 and is writ- 
ten into another frame memory 5 once. A format 
change circuit 6 changes the formats of the bright- 
ness data and the colour difference data stored in the 
^frame memories 4 and 5 to change the data from data 
in units of a frame to data in units of a block. The data 
in units of a block obtained by the format changing are 
supplied to and encoded by an encoder 7, and then 
supplied as a bit stream to and recorded onto a re- 
cording medium 8 in the form of an optical disk, a 
magneto-optical disk or a magnetic tape. 

Subsequently, data reproduced from the record- 
ing medium 8 is supplied as a bit stream to and de- 
coded by a decoder 9 of the decoding apparatus. A 
format change circuit 10 changes the format of the 
a decoded data from the decoder 9 to change the data 
from data in units of a block to data in units of a frame. 
The brightness data and the colour difference data 
outputted from the format change circuit 10 are sup- 
plied to and stored into a pair of frame memories 11 
and 12, respectively. Then, the brightness data and 
the colour difference data are read out from the frame 
memories 11 and 12 and converted from digital data 
into analog data by a pair of digital to analog (D/A) 
converters 13 and 14, respectively. They are then 
supplied as a brightness signal and a colour differ- 
ence signal to and composed by a post- processing 
circuit 15 and outputted to another circuit (not shown). 

The encoder 7 compresses picture data inputted 
thereto and supplies the thus compressed picture 
data to the recording medium 8, and the decoder 9 
decompresses such compressed picture data and 
outputs the thus decompressed picture data to the 
format change circuit 10. By compressing data in this 



manner, the amount of data to be stored onto the re- 
cording medium 8 can be reduced. Line correlation or 
inter-frame correlation of a picture signal is utilized for 
such compression. 

5 Where line correlation is utilized, a picture signal 

can be compressed, for example, by discrete cosine 
transform (DCT) or by some other processing. 

Where inter-frame correlation is utilized, a picture 
signal can be coded into a further compressed con- 

w dition. For example, when frame pictures PC1 , PC2 
and PC3 are generated at times t1 f t2 and t3, respec- 
tively, in Figure 22, the difference between picture 
signals of the frame pictures PC1 and PC2 is calcu- 
lated to produce a picture PC12, and the difference 

15 between picture signals PC2 and PC3 is calculated to 
produce another picture PC23. Since pictures of 
frames near to each other in time do not present a 
very great difference, if the difference between them 
is calculated, the difference signal has a small value. 

20 Therefore, if the difference signal is coded, then the 
amount of codes needed can be reduced. 

However, transmission of only such difference 
signals does not allow regeneration of the original pic- 
ture. Therefore, the picture of each frame is formed as 

25 one of three types of pictures including an I- picture, 
a P-picture and a B-picture to compress the picture 
signal. 

In particular, for example, referring to Figure 
23(A), a picture signal of 17 frames F1 to F17 is re- 

30 garded as a group of pictures and as one unit for proc- 
essing. Then, the picture signal of the first frame F1 
is coded as an l-picture; the second frame F2 is proc- 
essed as a B-picture; and the third frame F3 is proc- 
essed as a P-picture. Then, the fourth to 17th frames 

35 are processed alternately as B-pictures and P-pic- 
tures. 

For the picture signal of an l-picture, the picture 
signal for one full frame is coded and transmitted as 
it is. For the picture signal of a P-picture, basically the 

40 difference from the picture signal of an l-picture or a 
P-picture preceding in time is coded and transmitted 
as seen from Figure 23(A). Further, for the picture sig- 
nal of a B-picture, basically the difference from an 
average value between a frame preceding in time and 

45 another frame following in time is calculated as seen 
from Figure 23(B), and the difference is coded and 
transmitted. 

Figure 24 illustrates the principle of the method 
of coding a moving picture signal in this manner. As 

so seen from Figure 24, since the first frame F1 is proc- 
essed as an l-picture, it is coded as it is and transmit- 
ted as transmission data F1X into a transmission line 
(intra-picture coding). On the other hand, since the 
second frame F2 is processed as a B-picture, the dif- 

55 fere nee of the second frame F2 from an average val- 
ue between the frame F1 preceding in time and the 
frame F3 following in time is calculated, and the dif- 
ference is coded and transmitted as transmission data 
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F2X. 

More particularly, the processing for a B-picture 
includes four kinds of processing. The first kind of 
processing involves coding of data of the original 
frame F2 as it is and transmission of the coded data 
as transmission data F2X (SP1) (intra-picture coding) 
and is processing similar to that for an I- picture. In the 
second kind of processing, the difference from the 
frame F3 following in time is calculated, and the dif- 
ference (SP2) is coded and transmitted (backward 
predictive coding). In the third kind of processing, the 
difference (SP3) from the frame F1 preceding in time 
is coded and transmitted (forward predictive coding). 
Finally in the fourth kind of processing, the difference 
(SP4) from an average value between the frame F1 
preceding in time and the frame F3 following in time 
is calculated, and the difference is coded and trans- 
mitted as transmission data F2X. 

That one of the four methods which minimizes 
the amount of transmission data is adopted. 

It is to be noted that, when difference data is 
transmitted, a motion vector x1 from the picture (pre- 
dictive picture) of the frame which makes an object for 
calculation of the difference (a motion vector between 
the frames F1 and F2) (in the case of forward predic- 
tion) or x2 (a motion vector between the frames F3 
and F2) (in the case of backward prediction) or both 
of such motion vectors x1 and x2 are transmitted to- 
gether with the difference data. 

Further, forthe frame F3 of a P-picture, using the 
frame F1 preceding in time as a predictive picture, a 
difference signal (SP3) of the frame F3 from the 
frame F1 and a motion vector x3 are calculated, and 
they are transmitted as transmission data F3X (for- 
ward predictive coding). Or else, data of the original 
frame F3 is transmitted as it is as transmission data 
F3X (SP1) (intra-picture coding). That one of the 
methods which minimizes the amount of transmission 
data is selected similarly as in the case of a B-picture. 

Picture data of a frame which is constituted from 
V lines, each constituted from H dots, is divided, for 
example, for each 16 lines into N slices 1 to N, each 
including M macro blocks as seen from Figure 25. 
Each macro block includes block data Y[1] to Y[4] 
each including brightness data for 8 x 8 picture ele- 
ments (pixels), block data Cb[5] and Cr[6] which are 
colour difference data corresponding to all of (1 6 x 1 6) 
picture element data of the block data Y[1] to Y[4]. 

In particular, in a macro block, with regard to a 
brightness signal, picture element data of 16 x 16 pic- 
ture elements (Y[1] to Y[4]) which successively ap- 
pear in the horizontal and vertical scanning directions 
make a unit, but with regard to the two colour differ- 
ence signals corresponding to the brightness signal, 
colour d ifference data for 1 6 x 1 6 picture elements are 
allocated to each (8x8 picture elements) of the 
blocks Cr[6] and Cb[5] after reduction of the amount 
of data and time base multiplexing make a unit for 



processing. Picture data are arranged in each slice 
such that picture data appear successively in units of 
a macro block, and in each macro block, picture dkta 
5 appear successively in units of a block (8x8 dots) in 
the order of raster scanning. 

It is to be noted that the data Y[1] to Y[4], Cb[5] 
and Cr[6] are transmitted in this order. In other words, 
the numbers applied to the symbols represent the or- 
10 der in transmission. 

By compressing (thinning out) picture data of a 
high resolution, for example, picture data for high def- 
inition television, to 1/2 in each of the vertical and hor- 
izontal directions, picture data of a low resolution can 
is be obtained. If the aspect ratio of the picture data thus 
obtained is changed from 16:9 to 4:3, then the picture 
data can be displayed on a television receiver of the 
NTSC system. 

When it is tried to compress a picture of a high re- 
20 solution to 1/4 (= 1/2 x 1/2) and display it in this man- 
ner, a decoder of, for example, such a construction as 
shown in Figure 26 is employed as the decoder 9 of 
Figure 21 . It is to be noted that data of an input picture 
to the decoder 9 have been compressed by discrete 
25 cosine transform (DCT) by the encoder 7. 

Referring to Figure 26, picture data (DCT coeffi- 
cients) obtained by DCT processing in units of 8*x 8 
picture elements by the encoder 7 are supplied to a 
sampling circuit 21 of the decoder 9, from which, for 
30 example, such data for 8 x 8 picture elements as 
shown in Figure 27 are sampled out. Referring to Fig- 
ure 27, the 8x8 data are constituted from DCT coef- 
ficients, and the data correspond to higher frequency 
components of the picture in the vertical direction to- 
35 wards the bottom of Figure 27 while the data corre- 
spond to higher frequency components of the picture 
in the horizontal direction towards the right end of Fig- 
ure 27. ^ , 
Referring back to Figure 26, another sampling 
40 circuit 22 at the next stage samples out 4 x 4 DCT 
coefficients corresponding to lower frequency com- 
ponents shown in Figure 28 from the 8 x 8 DCT coef- 
ficients shown in Figure 27. The thus sampled out 
DCT coefficients are 4 x 4 coefficients at the left up- 
45 per corner of Figure 27. The 4x4 DCT coefficients 
sampled out by the sampling circuit 22 are inputted to 
an inverse discrete cosine transform circuit (I DCT) 
23, by which they are transformed by inverse discrete 
cosine transform. Consequently, picture data (4x4 
so picture element data) whose resolutions in the verti- 
cal and horizontal directions are reduced to 1/2 are 
obtained. 

In the conventional apparatus described above, 
when picture data of a lower resolution are to be pro- 
55 duced from picture data of a high resolution, only 
coefficients corresponding to low frequency compo- 
nents are sampled out. Consequently, an interlace 
structure included in high frequency components is 
lost. Therefore, the conventional apparatus has the 
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disadvantage that the picture of the low resolution 
does not present smooth motion. 

Further, when predictive coding is applied to such 
a system as described above wherein coded data for 
4x4 picture elements are sampled out on the decoder 
side from coded data processed by DCT processing 
^in units of 8 x 8 picture elements on the encoder side 
^to obtain a picture of a lower resolution by decoding, 
since a predictive picture produced on the decoder 
side does not coincide completely with another pre- 
dictive picture produced by a local decoder on the en- 
coder side, if the predictive picture produced on the 
decoder side is used for decoding, then a mismatch 
error will be accumulated. Such a mismatch error 
causes loss of an interlace structure in a picture of a 
low resolution and causes deterioration of the picture 
quality of a reproduced picture. 

The invention addresses the problem of providing 
^picture signal coding and decoding methods and pic- 
ture signal coding and decoding apparatus which can 
regenerate a picture of a low resolution which main- 
tains an interlace structure and exhibits smooth mo- 
tion. 

In order to attain the object described above, ac- 
cording to an aspect of the present invention, there is 
provided a picture signal decoding method of the type 
wherein, from coefficient data of a first block formed 
by orthogonal transformation of picture element data, 
those of the coefficient data of a second block having 
^a smaller range than the first block are sampled out, 
-and inverse orthogonal transformation is performed 
for the coefficient data of the second block, wherein 
the inverse orthogonal transformation is performed 
for data obtained by replacing at least one of the coef- 
ficient data in the second block by a corresponding 
one or ones of the coefficient data in the first block 
but outside the second block. 

According to another aspect of the present inven- 
tion, there is provided a picture signal coding appara- 
tus, which comprises orthogonal transformation 
means for transforming picture element data of a 
jframe formed from two fields and having an interlace 
structure by orthogonal transformation to form m x n 
coefficient data, quantization means for quantizing 
the coefficient data and outputting quantization data 
obtained by the quantization, and variable length cod- 
ing means for coding the quantization data into vari- 
able length codes and successively transmitting the 
quantization data in the order of those coefficient 
data of a first quantization data group which corre- 
spond to j x k ones of the m x n coefficient data, j being 
smaller than m, k being smaller than n, those coeffi- 
cient data of a second quantization data group which 
correspond to those of the m x n coefficient data 
which belong to the m-N+1th to mth rows in the first 
to kth columns, N being 1, 2, 3 and those coef- 
ficient data of a third quantization data group which 
correspond to those of the m x n coefficient data 



which do not belong to any of the first and second 
quantization data groups. 

According to a further aspect of the present in- 

5 vention, there is provided a picture signal decoding 
apparatus wherein transmission picture element data 
of a frame formed from two fields and having an in- 
terlace structure are transformed by orthogonal 
transformation to form m x n coefficient data, and 

10 then the coefficient data are quantized and coded 
into variable length codes to decode the transmission 
data, which comprises variable length decoding 
means for decoding the transmission data by variable 
length decoding to obtain decoded data and output- 

15 ting the decoded data, dequantization means for de- 
quantizing the decoded data to obtain coefficient 
data and outputting the coefficient data, sampling out 
means for sampling out, from the coefficient data, j x 
k coefficient data obtained by replacing successive 

20 ones of the coefficient data of the jth row by sums of 
the successive coefficient data of the jth row and cor- 
responding ones of the coefficient data of the mth 
row in the corresponding columns, j being smaller 
than m, k being smaller than n, and inverse orthogo- 

25 nal transformation means for transforming the j x k 
coefficient data sampled out by the sampling out 
means by inverse orthogonal transformation. 

According to a still further aspect of the present 
invention, there is provided a picture signal coding 

30 method, which comprises the steps of transforming 
picture element data of a frame formed from two 
fields and having an interlace structure by orthogonal 
transformation to form m x n coefficient data, quan- 
tizing the coefficient data and outputting quantization 

35 data obtained by the quantization, and coding the 
quantization data into variable length codes in the or- 
der of those coefficient data of a first quantization 
data group which correspond to j x k ones of the m x 
n coefficient data, j being smaller than m, k being 

40 smaller than n, those coefficient data of a second 
quantization data group which correspond to those of 
the m x n coefficient data which belong to the m- 
N+1th to mth rows in the first to kth columns, N being 
1, 2, 3 j-1, and those coefficient data of a third 

45 quantization data group which correspond to those of 
the m x n coefficient data which do not belong to any 
of the first and second quantization data groups. 

In the picture signal coding and decoding meth- 
ods and apparatus, picture data are processed by 

so DCT processing into m x n coefficient data. Of the m 
x n coefficient data, j x k coefficient data are transmit- 
ted. Of the j x k coefficient data, the coefficient data 
of the jth row are added to the coefficient data of the 
mth row and then transmitted. Or else, the coefficient 

55 data of the jth row are replaced by the coefficientdata 
of the mth row and then transmitted. 

Consequently, those of the coefficient data 
which correspond to a low frequency region are trans- 
mitted. Then, predetermined ones of the transmission 
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data are processed so that they include coefficient 
data of a higher frequency region. Accordingly, such 
a situation that smooth motion of the picture is distur- 
bed by the loss of an interlace structure is eliminated s 
or reduced. 

Embodiments of the invention will now be descri- 
bed, by way of example only, with reference to the ac- 
companying drawings in which: 

Figure 1 is a block diagram of a picture signal cod- 10 

ing apparatus; 

Figures 2(A) and 2(B) are diagrammatic views il- 
lustrating operation of a predictive mode change- 
over circuit of the picture signal coding apparatus 
of Figure 1 ; is 
Figures 3(A) and 3(B) are diagrammatic views il- 
lustrating operation of a DCT mode change-over 
circuit of the picture signal coding apparatus of 
Figure 1; 

Figure 4 is a table illustrating operation of an ad- 20 

dress control circuit shown in Figure 7; 

Figure 5 is table showing the order in which data 

illustrated in Figure 4 are scanned by zigzag 

scanning; 

Figure 6 is a block diagram of a picture signal de- 25 
coding apparatus; 

Figure 7 is a block diagram showing a selection 
circuit of the picture signal decoding apparatus of 
Figure 6; 

Figures 8 to 11 are diagrammatic views illustrat- 30 
ing different manners of motion compensation 
operation of a motion compensation circuit of the 
picture signal decoding apparatus of Figure 6 in 
a frame predictive mode (1), a field predictive 
mode, another frame predictive mode (2) and a 35 
further frame predictive mode (3), respectively; 
Figure 12 is a table showing data sampled out 
from a left upper corner area of the table of Figure 
4; 

Figure 13 is a table illustrating data when data in 40 
the fourth row and data in the eighth row in Fig- 
ure 4 are added to obtain data in the fourth row 
in Figure 12; 

Figure 14 is a table illustrating data when the data 

in the fourth row in Figure 4 are replaced by the 45 

data in the eighth row; 

Figure 1 5 is a table illustrating data when data in 
the third row and the data in the fourth row in Fig- 
ure 4 are replaced by data in the seventh row and 
the data in the eighth row, respectively; so 
Figure 16 is a table illustrating the order of zigzag 
scanning when data obtained by the processing 
illustrated in Figure 15 are to be transmitted; 
Figure 17 is a syntax diagram illustrating trans- 
mission of data when the zigzag scanning illu- 55 
strated in Figure 16 is performed; 
Figure 18 is a block diagram of another picture 
signal coding apparatus; 

Figure 19 is a block diagram of another picture 



signal decoding apparatus; 
Figure 20 is a block diagram showing a selection 
circuit of the picture signal coding apparatus of 
Figure 19; 

Figure 21 is a block diagram showing a conven- 
tional picture signal coding apparatus and a con- 
ventional picture signal decoding apparatus; 
Figure 22 is a diagrammatic view illustrating com- 
pression of data; 

Figures 23(A) and 23(B) are diagrammatic views 
showing different picture types when picture data 
are compressed; 

Figure 24 is a diagrammatic view illustrating the 
principle in coding a moving picture signal; 
Figure 25 is a diagrammatic view showing a trans- 
mission format; 

Figure 26 is a block diagram of a decoder of the 
picture signal decoding apparatus shown in Fig- 
ure 9; 

Figure 27 is a table illustrating data sampled out 
by a sampling circuit of the decoder shown in Fig- 
ure 26; and 

Figure 28 is a table illustrating data sampled out 
by another sampling circuit of the decoder shown 
in Figure 26. 

A picture signal coding apparatus and a picture 
signal decoding apparatus according to one embodi- 
ment of the present invention have basically similar 
constructions to the conventional picture signal cod- 
ing and decoding apparatus, respectively, described 
hereinabove with reference to Figure 21, but are dif- 
ferent in that the encoder 7 and the decoder 9 have 
different constructions to those of the conventional 
picture signal coding and decoding apparatus. There- 
fore, detailed description will be given below only of 
the encoder and the decoder of the picture signal 
coding and decoding apparatus while overlapping de- 
scription of common components of the picture signal 
coding and decoding apparatus to those of the con- 
ventional picture signal coding and decoding appara- 
tus is omitted herein to avoid redundancy. 

Referring first to Figure 1 , there is shown a form 
of encoder. Picture data to be coded are inputted in 
units of a macro block to a motion vector detection cir- 
cuit 50. The motion vector detection circuit 50 proc- 
esses picture data of each frame as an (-picture, a P- 
picture or a B -picture in accordance with a preset pre- 
determined sequence. As which ones of I-, P- and B- 
pictures pictures of frames sequentially inputted to 
the motion vector detection circuit 50 are to be proc- 
essed is determined in advance. For example, as 
shown in Figure 23, the pictures of a group of pictures 
constituted from frames F1 to F17 are processed as 

I-, B-, B-, P- B- and P-pictures, respectively. 

Picture data of a frame to be processed as an I- 
picture such as, for example, the frame F1, are trans- 
ferred from the motion vector detection circuit 50 to 
and stored in a forward original picture section 51a of 
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a frame memory 51 ; picture data of a frame to be proc- 
essed as a B-picture such as, for example, the frame 
F2, are transferred to and stored into a reference orig- 
inal picture section 51b; and picture data of a frame 5 
to be processed as a P-picture such as, for example, 
the frame F3, are transferred to and stored into a 
backward original picture section 51c. 

Further, when a picture of a frame to be process- 
ed as a B-picture (frame F4) or a P-picture (frame F5) 10 
is inputted at a next timing, the picture data of the first 
P-picture (frame F3) stored in the backward original 
picture section 51c until then are transferred to the 
forward original picture section 51a while the picture 
data of the next B-picture (frame F4) are stored (over- 15 
. written) into the reference original picture section 51b 
^and the picture data of the next P-picture (frame F5) 
are stored (overwritten) into the backward original 
picture section 51c. Such a sequence of operations as 
described above is repeated successively. 20 

A signal of a picture stored in the frame memory 
51 is read out from the frame memory 51 andthen 
processed by frame predictive mode processing or 
field predictive mode processing by a predictive mode 
change-over circuit 52. Further, under the control of 2s 
a predictive discrimination circuit 54, calculation for in- 
tra- picture prediction, forward prediction, backward 
^prediction or bidirectional prediction is performed by 
a calculation section or prediction circuit 53. Which 
one of the types of processing should be performed 30 
is determined based on a predictive error signal, that 
is, a difference between a reference original picture 
for an object of processing and a predictive picture for 
the reference original picture. Therefore, the motion 
vector detection circuit 50 generates an absolute val- 35 
ue sum or a square sum of predictive error signals 
which is used for such discrimination. 

Here, a frame predictive mode and a field predic- 
tive mode of the predictive mode change-over circuit 
' $ 52 will be described. 40 
When the frame predictive mode is set, the pre- 
dictive mode change-over circuit 52 outputs four 
brightness blocks Y[1] to Y[4] supplied from the mo- 
tion vector detection circuit 50 as they are to the cal- 
culation section 53 at the succeeding stage. In par tic- 45 
ular, in this instance, data of lines of odd-numbered 
fields and data of lines of even-numbered lines are 
present in a mixed condition in each brightness block. 
In the frame predictive mode, prediction is performed 
in units of four brightness blocks (macro blocks), and 50 
\one motion vector corresponds to four brightness 
blocks. 

On the other hand, in the field predictive mode, 
the predictive mode change-over circuit 52 processes 
a signal, which is inputted thereto from the motion 55 
vector detection circuit 50 and has such a construc- 
tion as illustrated in Figure 2(A), so that, for example, 
the brightness blocks Y[1] and Y[2] of the four bright- 
ness blocks are constituted from dots of lines of odd- 



numbered fields while the other two brightness 
blocks Y[3] and Y[4] are constituted from data of lines 
of even-numbered fields as seen from Figure 2(B). 
The predictive mode change-over circuit 52 outputs 
the resulted data to the calculation section 53. In this 
instance, one motion vector (a motion vector of the 
odd-numbered fields) corresponds to the two bright- 
ness blocks Y[1] and Y[2], and another one motion 
vector (a motion vector of the even- numbered fields) 
corresponds to the other two brightness blocks Y[3] 
and Y[4]. 

The motion vector detection circuit 50 outputs an 
absolute value sum of predictive errors in the frame 
predictive mode and another absolute value sum of 
predictive errors in the field predictive mode to the 
predictive mode change-over circuit 52. The predic- 
tive mode change-over circuit 52 compares the abso- 
lute value sums of predictive errors in the frame pre- 
dictive mode and the field predictive mode, performs 
processing of the absolute value sums corresponding 
to that one of the predictive modes in which the ab- 
solute value sum presents a lower value, and outputs 
the resulted data to the calculation section 53. 

Alternatively, such processing as described 
above may be performed by the motion vector detec- 
tion circuit 50. In particular, the motion vector detec- 
tion circuit 50 can output a signal corresponding to a 
determined mode to the predictive mode change- 
over circuit 52, and the predictive mode change-over 
circuit 52 outputs the signal as it is to the calculation 
section 53 at the succeeding stage. 

It is to be noted that, in the frame predictive 
mode, a colour difference signal is supplied to the cal- 
culation section 53 in a condition wherein data of lines 
of odd-numbered fields and data of tines of even- 
numbered fields are present in a mixed condition as 
seen from Figure 2(A). On the other hand, in the field 
predictive mode, upper halves (4 lines) of the colour 
difference blocks Cb[5] and Cr[6] are colour differ- 
ence signals of odd-numbered fields corresponding 
to the brightness blocks Y[1] and Y[2] while the lower 
halves (four lines) are colour difference signals of 
even-numbered fields corresponding to the bright- 
ness blocks Y[3] and Y[4] as seen from Figure 2(B). 

The motion vector detection circuit 50 produces 
an absolute value sum of predictive errors, which is 
to be used to determine which one of intra-picture pre- 
diction, forward prediction, backward prediction and 
bidirectional prediction should be performed by the 
predictive discrimination circuit 54, in the following 
manner. 

In particular, the motion vector detection circuit 
50 calculates, as an absolute value sum of predictive 
errors for intra-picture prediction, a difference be- 
tween an absolute value iZAij! of a sum SAij of signals 
Aij of a macro block of a reference original picture and 
a sum ZlAij! of absolute values lAij! of the signals Aij of 
the macro block. Further, the motion vector detection 
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circuit 50 calculates, as an absolute value sum of pre- 
dictive errors for forward prediction, a sum S'Aij - Bij! 
of absolute values lAij - Bij! of differences Aij - Bij be- 
tween signals Aij of a macro block of a reference orig- 
inal picture and signals Bij of another macro block of 
a predictive picture. Further, the motion vector detec- 
tion circuit 50 calculates absolute value sums for 
backward prediction and bidirectional prediction in a 
similar manner as for forward prediction (changing 
the predictive picture to another predictive picture dif- 
ferent from that in forward prediction). 

The absolute value sums thus calculated are sup- 
plied to the predictive discrimination circuit 54. The 
predictive discrimination circuit 54 selects, as an ab- 
solute value sum of predictive errors for inter-frame 
prediction, that one of the absolute value sums of pre- 
dictive errors for inter-frame predictions (forward pre- 
diction, backward prediction and bidirectional predic- 
tion) which has a smallest value. Further, the predic- 
tive discrimination circuit 54 compares the absolute 
value sum of predictive errors for the inter prediction 
and the absolute value sum of predictive errors for in- 
tra- picture prediction, selects that one of the absolute 
value sums which has a lower value, and sets a mode 
corresponding to the selected absolute value sum as 
a predictive mode. In particular, if the absolute value 
sum of predictive errors for intra- picture prediction is 
lower, the intra-picture predictive mode is set Con- 
versely, if the absolute value sum of predictive errors 
for inter-frame prediction is lower, a mode corre- 
sponding to that one of the absolute value sums in the 
forward predictive mode, the backward predictive 
mode and the bidirectional predictive mode which has 
a lowest value is set 

In this manner, the motion vector detection circuit 
50 supplies a signal for a macro block of a reference 
original picture corresponding to one of the frame pre- 
dictive mode and the field predictive mode selected 
by the predictive mode change-over circuit 52 to the 
calculation section 53 by way of the predictive mode 
change-over circuit 52, and detects a motion vector 
between a predictive picture corresponding to one of 
the four predictive modes selected by the predictive 
discrimination circuit 54 and a reference original pic- 
ture and outputs the detected motion vector to a va- 
riable length coding circuit 58 and a motion compen- 
sation circuit 64. As described above, the motion vec- 
tor is selected sothatthe corresponding absolute val- 
ue sum of predictive errors may be in the minimum. 

The predictive discrimination circuit 54 sets an in- 
tra-frame (intra-picture) predictive mode (in which no 
motion compensation is performed) as the predictive 
mode and changes over a switch 53d of the calcula- 
tion section 53 to a contact a side when the motion 
vector detection circuit 50 is reading out picture data 
of an l-picture from the forward original picture sec- 
tion 51a. Consequently, the picture data of an l-pic- 
ture are inputted to a DCT mode change-over circuit 



55. 

The DCT mode change-over circuit 55 puts data 
of four brightness blocks into a condition in which lines 
5 of odd-numbered fields and lines of even-numbered 
fields are present in a mixed condition (frame DCT 
mode) or another condition in which lines of odd-num- 
bered fields and lines of even-numbered fields are 
present in a separate condition (field DCT mode) as 
10 shown in Figure 3(A) or 3(B), and outputs the resulted 
data to a DCT circuit 56. 

In particular, the DCT mode change-over circuit 
55 compares a coding efficiency when data of odd- 
numbered fields and even-numbered fields are pres- 
15 ent in a mixed condition and are processed by DCT 
processing and another coding efficiency when such 
data are present separately and are processed by 
DCT processing, and selects a mode in which the 
coding efficiency is higher. 
20 For example, the DCT mode change-over circuit 

55 changes input signals to signals of a construction 
wherein lines of odd-numbered fields and even- 
numbered fields are present in a mixed condition as 
seen in Figure 3(A), calculates differences between 
25 the signals of lines of the odd-numbered fields and 
the signals of lines of the even-numbered fields which 
are adjacent to each other in the vertical direction, 
and calculates a sum of absolute values (or a square 
sum) of the differences. Or, the DCT mode change- 
30 over circuit 55 changes input signals to signals of an- 
other construction wherein lines of odd-numbered 
fields and lines of even-numbered fields are separate 
from each other as shown in Figure 3(B), calculates 
differences between the signals of lines of the odd- 
35 numbered fields which are adjacent to each other in 
the vertical direction and the signals of lines of the 
even-numbered fields which are adjacent to each 
other in the vertical direction, and calculates two 
sums of absolute values (or square sums) of the dif- 
40 ferences. Further, the DCT mode change-over circuit 
55 compares the two sums (absolute value sums) 
with each otherand sets a DCT mode corresponding 
to that of the sums which has a lower value. In par- 
ticular, if the former is lower, then the frame DCT 
45 mode is set, but if the latter is lower, then the field 
DCT mode is set. 

When the predictive mode change-over circuit 52 
sets the frame predictive mode (Figure 2(A)) and the 
DCT mode change-over circuit 55 sets theframe DCT 
so mode (Figure 3(A)) and when the predictive mode 
change-over circuit 52 sets the f ield predictive mode 
(Figure 2(B)) and the DCT mode change-over circuit 
55 sets the field DCT mode (Figure 3(B)), the DCT 
mode change-over circuit 55 need not change the ar- 
55 ray of data. 

In contrast, when the predictive mode change- 
over circuit 52 sets the field predictive mode (Figure 
2(B)) and the DCT mode change-over circuit 55 sets 
the frame DCT mode (Figure 3(A)) and when the pre- 
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■ dictive mode change-over circuit 52 sets the frame 
predictive mode (Figure 2(A)) and the DCT mode 
change-over circuit 55 sets the field DCT mode (Fig- 
ure 3(B)), the DCT mode change-over circuit 55 per- 
forms re-arrangement of data. In order to allow the 
processing to be realized, a predictive flag is supplied 
from the predictive mode change-over circuit 52 to 
the DCT mode change-over circuit 55. 

The DCT mode change-over circuit 55 outputs 
data of a construction corresponding to a selected 
DCT mode to the DCT circuit 56 and outputs a DCT 

^flag indicative of the selected DCT mode to the vari- 
able length coding circuit 58 and a conversion circuit 
65. 

As apparent from comparison between the pre- 
dictive mode (Figures 2(A) and 2(B)) of the predictive 
mode change-over circuit 52 and the DCT mode (Fig- 
ures 3(A) and 3(B)) of the DCT mode change-over cir- 
cuit 55, data structures of a brightness block in the dif- 
ferent modes are substantially the same as each 
other. 

When the predictive mode change-over circuit 52 
> ^selects the frame predictive mode (in which odd-num- 
bered lines and even-numbered lines are present in 
a mixed condition), the possibility thatthe DCT mode 
change-over circuit 55 may select the frame DCT 
mode (in which odd-numbered lines and even- 
numbered lines are present in a mixed condition) is 
high, but when the predictive mode change-over cir- 
cuit 52 selects the field predictive mode (in which data 
of odd-numbered fields and data of even-numbered 
fields are separate from each other), the possibility 
that the DCT mode change-over circuit 55 may select 
the field DCT mode (in which data of odd-numbered 
^fields and data of even-number fields are separate 
from each other) is high. 

However, this is not always the case, and the pre- 
dictive mode change-over circuit 52 decides a mode 
so that the absolute value sum of predictive errors 
may be minimized while the DCT mode change-over 
circuit 55 decides a mode so that a highest coding ef- 
ficiency may be achieved. 

Picture data of an l-picture outputted from the 
DCT mode change-over circuit 55 are inputted to the 
DCT circuit 56, processed by DCT (discrete cosine 
transform) processing and converted into DCT coef- 
ficients. The DCT coefficients are inputted to a quan- 
tization circuit 57, by which they are quantized with a 
quantization step corresponding to the amount of 
data (buffer accumulated amount) accumulated in a 
transmission buffer memory 59. The thus quantized 
data are inputted to the variable length coding circuit 
58. 

The variable length coding circuit 58 converts 
picture data (in the present case, data of an l-picture) 
supplied thereto from the quantization circuit 57 into 
a variable length code such as, for example, a Huff- 
man code in accordance with a quantization step 



(scale) supplied thereto from the quantization circuit 
57, and outputs the thus obtained variable length 
code to a transmission buffer memory 59. 

5 The quantized DCT coefficients are outputted, 

from the characteristic of the DCT, such that coeffi- 
cients of a low frequency region (high in power) are 
outputted to a left upper corner are (for example, 
those of 8 x 8 DCT coefficients shown at a left upper 

10 corner in Figure 4). Generally, a coefficient is coded 
into a variable length code in a combination of a run 
length of Os (zero run) and a coefficient (level). The 
system by which a coefficient is coded in a combina- 
tion of a zero run and a level is called run length cod- 

15 ing. When a code is coded by run length coding, a 
long zero run can be produced by performing trans- 
mission of coefficients in such an order called zigzag 
scanning as illustrated in Figure 5 (in Figure 5, the nu- 
merals indicate numbers in the order of transmission), 

20 and consequently, data can be compressed. 

The variable length coding circuit 58 receives a 
quantization step (scale) from the quantization circuit 
57, a predictive mode (set from among the intra-pic- 
ture predictive mode, the forward predictive mode, 

25 the rearward predictive mode and the bidirectional 
predictive mode) (block type) from the predictive dis- 
crimination circuit 54. a motion vector from the motion 
vector detection circuit 50, a predictive flag (a flag in- 
dicating which one of the frame predictive mode and 

30 the field predictive mode is set) from the predictive 
mode change-over circuit 52 and a DCT flag (a flag 
indicating which one of the frame DCT mode or the 
field DCT mode is set) outputted from the DCT mode 
change-over circuit 55. Also the data thus received 

35 are converted into variable length codes together 
with zigzag scanned quantization data. 

The transmission buffer memory 59 stores data 
transmitted thereto once and then outputs the data as 
a bit stream at a predetermined timing. Further, the 

40 transmission buffer memory 59 feeds back a quan- 
tized control signal in units of a macro block to the 
quantization circuit 57 in response to an amount of 
data remaining therein to control the quantization 
scale. Consequently, the transmission buffer mem- 

45 ory 59 adjusts the amount of data generated as a bit 
stream to keep the data in the inside thereof to an ap- 
propriate remaining amount (at which no overflow or 
underflow takes place). 

For example, if the remaining amount of data of 

so the transmission buffer memory 59 is increased to an 
allowable upper limit value, then the transmission 
buffer memory 59 increases the quantization scale of 
the quantization circuit 57 by means of a quantization 
control signal to reduce the amount of quantization 

55 data. Or on the contrary if the amount of remaining 
data of the transmission buffer memory 59 decreases 
to an allowable lower limit, the transmission buffer 59 
decreases the quantization scale of the quantization 
circuit 57 by way of a quantization control signal to in- 
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crease the amount of quantization data. 

A bit stream outputted from the transmission buf- 
fer memory 59 is multiplexed with a coded audio sig- 
nal, a code synchronizing signal and so forth, and fur- 
ther, a code for error correction is added to the mul- 
tiplexed signal, whereafter predetermined modula- 
tion is applied to the resulted signal. Then, the modu- 
lated signal is recorded as convex and concave bits 
onto a master disk by laser light. A stamper is formed 
making use of the master disk, and a large amount of 
copy disks (for example, optical disks) are formed 
from the stamper. 

Meanwhile, data of an l-picture outputted from 
the quantization circuit 57 are inputted to a dequanti- 
zation circuit 60, in which they are dequantized to a 
representative value in accordance with a quantiza- 
tion step supplied thereto from the quantization circuit 
57. The output of the dequantization circuit 60 is in- 
putted to and processed by inverse DCT processing 
by an IDCT (inverse DCT) circuit 61, and then input- 
ted to a conversion circuit 65. The conversion circuit 
65 returns the data inputted thereto from the IDCTcir- 
cuit61 into the condition of the frame predictive mode 
(Figure 2(A)) or into the condition of the field predic- 
tive mode (Figure 2(B)) in accordance with a DCTf lag 
supplied thereto from the DCT mode change-over cir- 
cuit 55 and a predictive flag outputted from the pre- 
dictive mode change-over circuit 52 so that they may 
coincide with the condition of predictive picture data 
outputted from the motion compensation circuit 64, 
and outputs the resulted data to an arithmetic unit 62. 
The data outputted from the arithmetic unit 62 are in- 
putted to a conversion circuit 66, by which they are re- 
turned into those of the condition in the frame predic- 
tive mode (the condition shown in Figure 2(A)) in re- 
sponse to a predictive flag. The resulted data is sup- 
plied to and stored into a forward predictive picture 
section 63a of the frame memory 63. 

It is to be noted that the frame memory 63 can be 
substituted by a field memory, and in this instance, 
since data are stored individually for each field, data 
outputted from the arithmetic unit 62 are returned into 
those of the condition in the field predictive mode (the 
condition of Figure 2(B)) by the conversion circuit 66. 

The motion vector detection circuit 50 first proc- 
esses, when it is to process picture data of frames in- 
putted sequentially thereto as, for example, I-, B-, P- 
, B-, P-, B-, ... pictures, the picture data of a frame in- 
putted first as an l-picture and then processes, before 
another picture inputted subsequently is to be proc- 
essed as a B- picture, picture data of a further picture 
inputted subsequently to the second picture as a P- 
picture. This is because a B-picture involves back- 
ward prediction and accordingly cannot be decoded 
unless a P-picture as a backward predictive picture is 
prepared beforehand. 

Therefore, the motion vector detection circuit 50 
starts, after processing of the l-picture, processing of 



picture data of a P-picture stored in the backward 
original picture section 51c. Then, similarly as in the 
case described above, an absolute value sum of inter- 
5 frame differences (predictive errors) in units of a mac- 
ro block is supplied from the motion vector detection 
circuit 50 to the predictive mode change-over circuit 
52 and the predictive discrimination circuit 54. The 
predictive mode change-over circuit 52 and the pre- 
10 dictive discrimination circuit 54 set, in accordance 
with the absolute valve sum of predictive errors of the 
macro block of the P-picture, the frame or field pre- 
dictive mode or the intra-picture predictive, forward 
predictive, backward predictive or bidirectional pre- 
15 dictive mode (block type), respectively. 

The calculation section 53 changes over the 
switch 53d to the contact a side as described above 
when the intra-frame predictive mode is set Accord- 
ingly, the data are transmitted to the transmission line 
20 by way of the DCT mode change-over circuit 55, the 
DCT circuit 56, the quantization circuit 57, the vari- 
able length coding circuit 58 and the transmission 
buffer memory 59 similarly as the data of the l-pic- 
ture. Further, the data are supplied to and stored into 
25 the backward predictive picture section 63b of the 
frame memory 63 by way of the dequantization circuit 
60, the IDCT circuit 61, the conversion circuit 65, the 
arithmetic unit 62 and the conversion circuit 66. \ . 
In the forward predictive mode, the switch 53d is 
30 changed over to the contact b and picture data stored 
in the forward predictive picture section 63a of the 
frame memory 63 (in the present case, data of the I- 
picture) are read out and undergo motion compensa- 
tion by the motion compensation circuit 64 in accor- 
35 dance with a motion vector outputted from the motion 
vector detection circuit 50. In particular, when setting 
of the forward predictive mode is instructed by the 
predictive discrimination circuit 54, the motion com- 
pensation circuit 64 displaces the read address of J he 
40 forward predictive picture section 63a by an amount 
corresponding to the motion vector from a position 
corresponding to the position of the macro block be- 
ing outputted at present from the motion vector detec- 
tion circuit 50, reads out data from the displaced ad- 
45 dress and produces predictive picture data. Further, 
in this instance, the motion compensation circuit 64 
arrays the predictive picture data into those of the 
condition shown in Figure 2(A) or 2(B) in response to 
a frame/field predictive flag supplied thereto from the 
so predictive mode change-over circuit 52. 

The predictive picture data outputted from the 
motion compensation circuit 64 are supplied to an ar- 
ithmetic unit 53a. The arithmetic unit 53a subtracts 
the predictive picture data supplied thereto from the 
55 motion compensation circuit 64 and corresponding to 
a macro block of a reference original picture from data 
of the macro block supplied thereto from the predic- 
tive mode change-over circuit 52, and outputs the dif- 
ference (predictive error) between them. The differ- 
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ence data is transmitted into the transmission line by 
way of the DCT mode change-over circuit 55, the 
DCT circuit 56, the quantization circuit 57, the vari- 
able length coding circuit 58 and the transmission 
buffer memory 59. Further, the difference data is lo- 
cally decoded by the dequantization circuit 60, the 
SIDCT circuit 61 and the conversion circuit 65 and then 
inputted to the arithmetic unit 62. 

Data same as the predictive picture data supplied 
to the arithmetic unit 53a is also supplied to the arith- 
metic unit 62. The arithmetic unit 62 adds the predic- 
tive picture data outputted from the motion compen- 
sation circuit 62 to the difference data outputted from 
the conversion circuit 65. Consequently, picture data 
of an original (decoded) P-picture are obtained. How- 
ever, since the data have undergone arraying proc- 
essing as shown in Figure 2(A) or 2(B) by the predic- 
ative mode change-over circuit 52, processing for re- 
turning the array into that of the condition in the frame 
predictive mode (the condition shown in Figure 2(A)) 
(where the frame memory 63 is constituted otherwise 
from a field memory, the condition in the field predic- 
tive mode (the condition shown in Figure 2(B)) is per- 
formed in response to a predictive flag by the conver- 
sion circuit 66. The picture data of the P-picture are 
supplied to and stored into the backward predictive 
picture section 63b of the frame memory 63. 

The motion vector detection circuit 50 executes 
processing of a B-picture after the data of the l-pic- 
Hture and the P-picture have been stored into the for- 
ward predictive picture section 63a and the backward 
predictive picture section 63b, respectively. In re- 
sponse to the magnitude of the absolute value sum 
of inter-frame differences in units of a macro block, 
the predictive mode change-over circuit 52 sets the 
frame or field predictive mode and the predictive dis- 
crimination circuit 54 sets the intra-fra me/for- 
ward/backward/bid irectionai predictive mode (block 
type) to one of the intra-frame predictive mode, the 
forward predictive mode, the backward predictive 
, mode and the bidirectional predictive mode. 

As described above, when in the intra-frame pre- 
dictive mode or the forward predictive mode, the 
switch 53d is changed over to the contact a or b. In 
this instance, processing similar to that for the P-pic- 
ture is performed, and resulted data are transmitted. 

In contrast, when the backward predictive mode 
or the bidirectional predictive mode is set, the switch 
53d is changed over to the contact c or d. 

When in the forward predictive mode in which the 
switch 53d is changed over to the contact c, data of 
a picture stored in the backward predictive picture 
;\section 63b (in the present case, the picture data of 
a P-picture) are read out and undergo motion com- 
pensation by the motion compensation circuit 64 in 
accordance with a motion vector outputted from the 
motion vector detection circuit 50. In particular, when 
setting of the backward predictive mode is instructed 



from the predictive discrimination circuit 54, the mo- 
tion compensation circuit 64 displaces the read ad- 
dress of the backward predictive picture section 63b 

5 by an amount corresponding to the motion vector 
from a position corresponding to the position of a 
macro block being outputted at preset from the motion 
vector detection circuit 50, reads out data from the 
thus displaced address, and produces predictive pic- 

10 ture data. Further, the motion compensation circuit 64 
arrays the data in such a manner as illustrated in Fig- 
ure 2(A) or 2(B) in response to a predictive flag out- 
putted from the predictive mode change-over circuit 
52. 

15 The predictive picture data outputted from the 

motion compensation circuit 64 are supplied tothe ar- 
ithmetic unit 53b. The arithmetic unit 53b subtracts 
the predictive picture data supplied thereto from the 
motion compensation circuit 64 from data of a macro 
20 block of a reference original picture supplied thereto 
from the predictive mode change-over circuit 52, and 
outputs the differences between them. The differ- 
ence data are transmitted into the transmission line 
by way of the DCT mode change-over circuit 55, the 
25 DCT circuit 56, the quantization circuit 57, the vari- 
able length coding circuit 58 and the transmission 
buffer memory 59. 

When the bidirectional predictive mode wherein 
the switch 53d is changed over to the contact d is set, 
30 data of a picture stored in the forward predictive pic- 
ture section 63a (in the present case, the picture of 
an l-picture) and data of another picture stored in the 
backward predictive picture section 63b (in the pres- 
ent case, the picture of a P-picture) are read out and 
35 undergo motion compensation by the motion com- 
pensation circuit 64 in response to a motion vector 
outputted from the motion vector detection circuit 50. 
In particular, when setting of the bidirectional predic- 
tive mode is instructed from the predictive discrimin- 
40 ation circuit 54, the motion compensation circuit 50 
displaces the read addresses of the forward predic- 
tive picture section 63a and the backward predictive 
picture section 63b by amounts corresponding to mo- 
tion vectors for a forward predictive picture and a 
45 backward predictive picture from positions corre- 
sponding to the positions of a macro block being out- 
putted at present from the motion vector detection cir- 
cuit 50, reads out data from the thus displaced ad- 
dresses, and produces predictive picture data. Fur- 
so ther, the data are arranged in response to a predictive 
flag from the predictive mode change-over circuit 52. 

The predictive picture data outputted from the 
motion compensation circuit 64 are supplied to an ar- 
ithmetic unit 53c. The arithmetic unit 53c subtracts an 
55 average value of the predictive picture data supplied 
thereto from the motion compensation circuit 64 from 
data of a macro block of a reference original picture 
supplied thereto from the motion vector detection cir- 
cuit 50, and outputs the difference between them. 
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The difference data is transmitted into the transmis- 
sion line by way of the DCT mode change-over circuit 
55, the DCT circuit 56, the quantization circuit 57, the 
variable length coding circuit 58 and the transmission 
buffer memory 59. 

Any picture data of a P-picture is not stored into 
the frame memory 63 because it is not used as a pre- 
dictive picture for any other picture. 

It is to be noted that the forward predictive picture 
section 63a and the backward predictive picture sec- 
tion 63b of the frame memory 63 perform bank 
changing over when necessary, and a predetermined 
reference original picture stored in one or the other of 
them can be switchably outputted as a forward pre- 
dictive picture or a backward predictive picture. 

While the foregoing description has been given 
mainly of brightness blocks, also colour difference 
blocks are processed and transmitted in units of a 
macro block shown in Figures 2(A) or 2(B) and 3(A) 
or 3(B). It is to be noted that a motion vector used 
when a colour difference block is processed is ob- 
tained by reducing a motion vector of a corresponding 
brightness block to one half in each of the vertical and 
horizontal directions. 

Referring now to Figure 6 t there is shown a de- 
coder. An input bit stream is inputted to the decoder 
from an optical disk (recording medium 8 shown in 
Figure 21) or a like recording medium. The input bit 
stream is inputted by way of a reception buffer mem- 
ory 70 to and decoded by a variable length decoding 
circuit (IVLC) 71 . As a result of the decoding, quan- 
tized data (DCT coefficients), motion vectors, predic- 
tive modes, predictive flags, DCT flags, quantization 
scales and so forth are obtained. Data (DCT coeffi- 
cients) outputted from the variable length decoding 
circuit 71 are inputted to and dequantized to represen- 
tative values by a dequantization circuit 72. The de- 
quantization step is controlled in response to a quan- 
tization scale outputted from the variable length de- 
coding circuit 71. 

Quantized regenerated values (DCT coeffi- 
cients) as an output of the dequantization circuit 72 
are outputted as 8 x 8 values for each block. An IDCT 
circuit 73 performs IDCT processing of the 8x8 coef- 
ficients. Consequently, a block of 8 x 8 picture ele- 
ment data is obtained. The output of the IDCT circuit 

73 is inputted to a conversion circuit 77, in which it is 
returned in response to a DCT flag and a predictive 
flag supplied thereto from the variable length decod- 
ing circuit 71 into the array condition in which it coin- 
cides with the array of data outputted from the motion 
compensation circuit 74. The output of the conversion 
circuit 77 is supplied to an arithmetic unit 74. 

When picture data supplied to the arithmetic unit 

74 are data of an l-picture, the data are outputted from 
the arithmetic unit 74 and returned in response to pre- 
dictive flag supplied thereto from the variable length 
decoding circuit 71 by a conversion circuit 78 into 



those of the condition in the frame predictive mode 
shown in Figure 2(A) (when a frame memory 75 is 
constituted from a field memory, the condition of the 

5 field predictive mode (the condition shown in Figure 
2(B)), whereafter they are supplied to and stored into 
a forward predictive picture section 75a of the frame 
memory 75 in order to allow production of predictive 
picture data for picture data (data of a P-picture or a 

10 B-picture) to be inputted to the arithmetic unit 74 later. 
Further, the data are outputted as they are to, for ex- 
ample, the format conversion circuit 10 (Figure 21) at 
the succeeding stage. 

When picture data supplied to the arithmetic unit 

15 74 are data of a P-picture produced using picture data 
of a preceding frame as predictive picture data and 
the forward predictive mode is set, the picture data of 
the preceding frame (data of the l-picture) stored in 
the forward predictive picture section 75a of the 

20 frame memory 75 are read out and undergo motion 
compensation corresponding to a motion vector out- 
putted from the variable length decoding circuit 71 
and processing corresponding to the predictive mode 
(block type) by the motion compensation circuit 76. 

25 Further, data are arrayed as shown in Figure 2(A) or 
2(B) in response to the predictive flag. Then, the ar- 
ithmetic unit 74 adds picture data (difference data) 
supplied thereto from the conversion circuit 77 to the 
data from the motion compensation circuit 76 and out- 

30 puts the resulted data therefrom. The data obtained 
by the addition, that is, the decoded data of the P-pic- 
ture, are supplied to and stored into the backward pre- 
dictive picture section 75b of the frame memory 75 in 
order to allow production of predictive picture data for 

35 picture data (data of a B-picture or a P-picture) to be 
inputted to the arithmetic unit 74 later. 

Even when the data are data of a P-picture, the 
data in the intra-picture predictive mode are not proc- 
essed by particular processing by the arithmetic unit 

40 74 and are stored as they are into the backward pre- 
dictive picture section 75b similarly to the data of the 
l-picture. 

Since the P-picture is a picture to be displayed 
subsequently to a succeeding B-picture, it is not qut- 
45 putted at this point of time to the format conversion 
circuit 10 at the succeeding stage as yet (as descri- 
bed above, the P-picture inputted succeedingly to the 
B-picture is processed and transmitted prior to the B- 
picture). 

50 When the picture data supplied from the conver- 

sion circuit 77 are data of a B-picture, the picture data 
of the l-picture stored in the forward predictive picture 
section 75a of the frame memory 75 (in the case of 
the forward predictive mode), the picture data of the 

55 P-picture stored in the backward predictive picture 
section 75b (in the case of the backward predicfive 
mode) or the picture data of both of the l-picture and 
the P-picture are read out in response to a predictive 
mode supplied from the variable length decoding cir- 
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cuit 71, and motion compensation is performed for 
the thus read out picture data in accordance with a 
^motion vector outputted from the variable length de- 
coding circuit 71 by the motion compensation circuit 
76. The picture data after the motion compensation 
are then processed by arraying processing of data in 
response to a predictive flag to produce a predictive 
picture. However, when no motion compensation is 
required (in the case of the intra-picture predictive 
mode), no predictive picture is produced. 

The data obtained by motion compensation by 
the motion compensation circuit 76 in this manner are 
added to the output of the conversion circuit 77 by the 
^arithmetic unit 74. The addition output is returned into 
the signals of the condition in the frame predictive 
mode in response to the predictive flag by another 
conversion circuit 78 and then outputted to the format 
conversion circuit 10. 

However, since the addition output is data of a B- 
picture and is not utilized for production of a predictive 
picture for any other picture at all, it is not stored into 
the frame memory 75. 

After the picture of a B-picture is outputted, pic- 
ture data of the P-picture stored in the backward pre- 
dictive picture section 75b are read out and outputted 
^ by way of the motion compensation circuit 76, the ar- 
ithmetic unit 74 and the conversion circuit 78. In this 
instance, motion compensation, arraying processing 
or the like is not performed. 

Further, while the foregoing description has been 
given of processing of a brightness signal, processing 
of a colour difference signal is performed in a similar 
manner. In this instance, however, a motion vector 
used is obtained by reducing a motion vector for a 
brightness signal to one half in each of the vertical 
and horizontal directions. 
I If the picture regenerated in such a manner as de- 
scribed above is converted from digital to analog val- 
ues, then a decoded picture of a high definition tele- 
vision system of a high resolution can be obtained. 

The decoder described above includes, in addi- 
tion to the construction for obtaining a decoded pic- 
ture of a high definition television system described 
above, another construction for obtaining a decoded 
picture of a resolution equal to one fourth the resolu- 
tion of the standard television system. The second 
construction includes a dequantization circuit 81, 
which dequantizes data outputted from the variable 
! length decoding circuit 71 to a representative value in 
accordance with a quantization scale also outputted 
from the variable length decoding circuit 71 and out- 
puts the resulted data to a selection circuit 82. It is to 
be noted that the dequantization circuit 81 is provided 
in order to obtain a standard television video output to- 
gether with a high definition television video output, 
and when it is required to output only one of the two 
outputs, the dequantization circuit 81 may be omitted. 
In this instance, the output of the dequantization cir- 



cuit 72 is supplied to the selection circuit 82. 

Referring now to Figure 7, the selection circuit 82 
may be constituted from a calculation circuit 90, an 
; address control circuit 91 and a memory 92. Data sup- 
plied from the dequantization circuit 81 (or 72) are 
written into the memory 92. Then, the data are read 
outfrom the memory 92 and outputted to an IDCT cir- 
cuit 83. Writing into and reading outfrom the memory 
\o 92 is controlled by an address control circuit 91 . While 
details of the writing and reading control will be here- 
inafter described, the selection circuit 82 selects pre- 
determined 4x4 DCT coefficients from such 8x8 
DCT coefficients as shown in Figure 4. 
15 Referring back to Figure 6, the IDCT circuit 83 

processes the inputted 4x4 coefficients by IDCT 
processing and outputs the resulted data to a conver- 
sion circuit 88. The conversion circuit 88 returns the 
array of the data, in response to a DCT flag and a pre- 
20 dictive flag outputted from the variable length decod- 
ing circuit 71, into that of a condition wherein it coin- 
cides with the array of predictive picture data output- 
ted from a motion compensation circuit 86. The con- 
version circuit 88 outputs the data after such array 
25 change to an arithmetic unit 84. The motion compen- 
sation circuit 86 performs motion compensation of 
picture data stored in a frame memory 85 in response 
to a motion vector and a predictive mode supplied 
thereto from the variable length decoding circuit 71, 
30 and then performs such array conversion of the pic- 
ture data as illustrated in Figure 2(A) or 2(B) in re- 
sponse to a predictive code to produce predictive pic- 
ture data. 

The data outputted from the motion compensa- 
35 tion circuit 86 are added to the output of the conver- 
sion circuit 88. The array condition of the resulted 
data is converted, in response to the predictive flag, 
into the condition in the frame predictive mode (the 
condition of the field predictive mode when the frame 
40 memory 85 is constituted from a field memory), and 
then the data are outputted as standard television pic- 
ture data. It is to be noted that, since motion at the mo- 
tion compensation circuit 86 is equal to about one half 
the motion at the motion compensation circuit 76, a 
45 motion vector outputted from the variable length de- 
coding circuit 71 is converted to one half by scale con- 
version by a scaling circuit 87 and then supplied to the 
motion compensation circuit 86. 

In particular, when the predictive mode in the en- 
50 coder of Figure 1 is determined as the frame predic- 
tive mode by the predictive discrimination circuit 54 of 
the encoder, also the predictive mode in the decoder 
is set to the frame predictive mode. On the other 
hand, when the predictive mode in the encoder is de- 
55 termined as the field predictive mode, also the pre- 
dictive mode in the decoder is set to the field predic- 
tive mode. In short, when the the motion compensa- 
tion circuit 64 of the encoder forms a predictive pic- 
ture in the frame predictive mode, the motion com- 
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pensation circuit 86 of the decoder cooperates with 
the scaling circuit 87 to form a predictive picture in the 
frame predictive mode similarly. On the other hand, 
when the motion compensation circuit 64 forms a pre- 
dictive picture in the field predictive mode, the motion 
compensation circuit 86 cooperates with the scaling 
circuit 87 to form a predictive picture in the field pre- 
dictive mode similarly. 

Subsequently, the relationship between motion 
compensation and the frame or field predictive mode 
will be described. In the case of the frame predictive 
mode (frame predictive mode (1)), in motion compen- 
sation of the encoder performed by the motion com- 
pensation circuit 64 (similar with motion compensa- 
tion of the motion compensation circuit 76 of a high 
definition television decoder block), a single predic- 
tive frame is formed as a predictive picture from a first 
field (odd-numbered field) including such picture ele- 
ments a, c t e, g, ... as shown in (a) of Figure 8 and a 
second field (even- numbered field) including such 
picture elements b, d, f f ... as shown in (a) of Figure 
8. Meanwhile, in motion compensation for a standard 
television decoder block performed by the motion 
compensation circuit 86 of the decoder, a single pre- 
dictive frame is formed as a predictive picture from a 
first field including such picture elements a', c\ ... as 
shown in (b) of Figure 8 and a second field including 
such picture elements z\ b', d\ ... (the distance be- 
tween z' and b' and the distance between b' and 
d' are equal to each other) as shown in (b) of Figure 
8. 

In order to convert data of a high resolution (high 
definition television) into data of a 1/4 resolution, pic- 
ture elements should be thinned out to one half in 
both of the horizontal direction and the vertical direc- 
tion. Now, considering only thinning out in the vertical 
direction, since a frame has an interlace structure 
based on two fields, if lines are thinned out to one half 
in the vertical direction, then data of one field (in the 
case shown in Figure 8, the first field) after all corre- 
spond to data of one frame of a 1/4 resolution (2 
fields). In the case shown, the picture elements a, 
e, ... among the picture elements a, c, e, g, ... of the 
first field of a high resolution correspond to the pic- 
ture elements a', c\ ... of the first field of a low reso- 
lution, and the picture elements c f g, ... correspond to 
the picture elements b\ d' ( ... of the second field of a 
low resolution. 

Describing, for example, the picture element a, in 
the local decoder ((a) in Figure 8) of the encoder, if 0, 
1 , 2, 3 or 4 (1 of the motion vector indicates an offset 
corresponding to 0.5 picture elements in the vertical 
directions of a screen of a high resolution) is outputted 
as a motion vector for motion compensation for the 
picture element a (it is assumed that the motion vec- 
tor indicates only motion in the vertical direction) from 
the motion vector detection circuit 50, then a, (a + 
b)/2, b, (b + c)/2 or c is outputted as a picture element 



of a predictive picture from the motion compensation 
circuit 64. In particular, an interpolation picture ele- 
ment is formed when the motion vector is equal (o 1 
5 or 3. 

On the other hand, on the standard television de- 
coder block side ((b) in Figure 8), when 0, 1, 2, 3 or 4 
is outputted as a motion vector for motion compensa- 
tion for the picture element a' from the variable length 

10 decoding circuit 71 (when the motion vector outputted 
from the scaling circuit 87 is 0, 0.5, 1, 1.5 or 2), a', 
(3a' + b')/4, (3b' + z')/4, (a' + 3b')/4 or b is outputted 
as a picture element of a predictive picture from the 
motion compensation circuit 86. In particular, when 

is the motion vector is 1 f 2 or 3 (when the motion vector 
outputted from the scaling circuit 87 is 0.5, 1 or 1^5), 
an interpolation picture element is formed. This simi- 
larly applies also where the motion vector is greater 
than 5). 

20 As seen from Figure 8, picture element data of a 

low resolution (1/4 resolution) correspond to picture 
element data of a high resolution (full resolution) of 
the encoder such that the parities (fields) and the 
positions of them coincide with each other. In partic- 

25 ular, when the motion vector is 1 or 3, picture element 
data of a high resolution are interpolated from the pic- 
ture element data a and c of the first field and the pic- 
ture element data b of the second field ((a + b)/2 or 
(b + c)/2). On the other hand, also picture element 

30 data of a low resolution are interpolated, when the 
motion vector is 1 or 3 (when the motion vector out- 
putted from the scaling circuit 87 is 0.5 or 1.5), from 
the picture element data a' of the first field and the 
picture element data b' of the second field. Accord- 

35 ingly, they coincide with each other in parity (field) 
(both of them are interpolated from the first and sec- 
ond fields). Further, since the weighting values of the 
picture elements of them are adjusted, the positions 
of them in the vertical direction coincide with each 

40 other. 

Further, when the motion vector Is equal to 2 
(when the motion vector outputted from the scaling 
circuit 87 is equal to 1), since the picture element data 
b of a high resolution is data of the second field, also 

45 a corresponding picture element of a low resolution is 
interpolated from the picture elements z p and b' of the 
second field ((3b' + z')/4). Consequently, the parities 
and the positions in the vertical direction of them co- 
incide with each other. 

so Subsequently, motion compensation in the field 

predictive mode will be described with reference to 
Figure 9. In this instance, in the local decoder of the 
encoder, as seen from (a) of Figure 9 t picture ele- 
ments (a + c)/2 and (c + e)/2 of a first predictive field 

55 are formed as a predictive picture from a first field in- 
cluding picture elements a, c, e, g, .... and picture ele- 
ments (b + d)/2 and (d + f)/2 of a second predictive 
field are formed as another predictive picture from a 
second field including picture elements b, d, f, ... 

13 
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Meanwhile, in the standard television decoder block, 
as seen from (b) of Figure 9, picture elements (3a* + 
c')/4, (a* + C)/2 and (tf + 3c')/4 of a first predictive field 
are formed as a predictive picture from a first field in- 
cluding picture elements a\ c\ ... and picture ele- 
ments (3b' + z")/4, (3b' + d')/4 and (b f + d')/2 of a sec- 
ond predictive field are formed as a predictive picture 
from a second field including picture elements z", b\ 
d* ... (the distance between z' and b' and the dis- 
tance between b* and d' are equal to each other). 
In particular, in the case of motion compensation, 
for example, for the picture element a of the first field 
in accordance with a motion vector, in the encoder, 
when 0, 1, 2, 3 or 4 is given as a motion vector from 
the motion vector detection circuit 50, a, (a + c)/2, c, 
(c + e)/2 or e is outputted as a picture element of a pre- 
dictive picture from the motion compensation circuit 
64. respectively. When the motion vector is 1 or 3, the 
picture element is interpolated. 

Meanwhile, on the standard television decoder 
■■. a block side, when 0, 1 . 2, 3 or 4 is give as a motion vec- 
tor from the variable length decoding circuit71 (when 
the motion vector outputted from the scaling circuit 87 
is 0, 0.5, 1, 1.5 or 2), a', (3a' + c')/4, (a 1 + c')/2, (a' + 
3c')/4 or C is outputted as a picture element of a pre- 
dictive picture from the motion compensation circuit 
86, respectively. When the motion vector is 1 , 2 or 3 
(when the motion vector outputted from the scaling 
circuit 87 is 0.5, 1 or 1.5), an interpolation picture ele- 
ment is formed by interpolation so that the position of 
the corresponding picture element may coincide with 
that in the encoder. 

\ On the other hand, in motion compensation of the 
picture element of the second field, when 0, 1, 2, 3 or 
4 is given as a motion vector to the encoder, b, (b + 
dy2, d,(d + f)/2 orf is outputted as a picture element 
of a predictive picture from the motion compensation 
circuit 64, respectively. Meanwhile, on the standard 
television decoder block side, when 0, 1, 2, 3 or 4 is 
given as a motion vector (when the motion vector out- 
putted from the scaling circuit 87 is O, 0.5, 1, 1.5 or 
2), (3b' + z')/4, b\ (3b' + d')/2, (b' + d')/2 or (b' + 3d')/4 
is outputted as a picture element of a predictive pic- 
>. ture from the motion compensation circuit 86, respec- 
tively. 

An original picture element which corresponds to 
the picture element b of the second f ield of a full re- 
solution is not present in the second field of a 1/4 re- 
solution. If the picture element b' is made coincide 
with the picture element b, then since the positions of 
them in the vertical direction do not coincide with 
each other, also the motion compensated picture ele- 
ment is displaced from the original picture element. 
Therefore, the picture element (3b* + z')/4 is produced 
at the position at which it coincides with the picture 
element b. 

In each field, since each interpolation data is pro- 
duced from data in the field, also the parities coincide 



with each other. 

Adifferentmanner of motion compensation in the 
frame predictive mode (frame predictive mode (2)) will 
5 be described subsequently with reference to Figure 
10. The present manner of motion compensation is 
different from the manner of motion compensation in 
the frame predictive mode (1) of Figure 8 in process- 
ing on the standard television decoder block side. 
10 While a reference picture element when the motion 
vector is 1, 2 or 3 (when the motion vector outputted 
from the scaling circuit 87 is 0.5, 1 or 1 .5) can be pro- 
duced by interpolation of the picture element a 1 , 
b' and/or z' similarly as in the case of Figure 8, a ref- 
15 erence picture element when the motion vector is 4 
(when the motion vector outputted from the scaling 
circuit 87 is 2) is produced by interpolation of the pic- 
ture elements a' and c' of the first field since it is re- 
ferred to from a field of a same parity as a reference 
20 picture element in the encoder, and the picture ele- 
ment of a predictive picture to be outputted from the 
motion compensation circuit is (a 1 + c')/2. In other 
words, in this instance, the picture element b' is used 
only for interpolation of some other picture element 
25 and is not itself outputted as a reference picture ele- 
ment. 

Figure 11 is a further manner of motion compen- 
sation in the frame predictive mode (frame predictive 
mode (3)). In the present manner of motion compen- 
30 sation, in the case of a 1/4 resolution, when the mo- 
tion vector is 1 or 3 (when the motion vector outputted 
from the scaling circuit 87 is 0.5 or 1.5), a reference 
picture element is either interpolated as (1/2) (a' + 
(3b' + z')/4) from the picture elements a' and (3b* + 
35 z')/4 or interpolated as (1/2)((a' + c')/2 + (3b' + z')/4) 
from the picture elements (a* + cyi and (3b' + z')/4. 
Except this, the present manner of motion compen- 
sation is the same as the manner of motion compen- 
sation of Figure 10. 
40 When motion compensation is performed in re- 

sponse to the frame orf ield predictive mode (predic- 
tive flag) so that coincidence in parity and position 
may be established in this manner, since mismatch 
errors arising from incoincidence between a predic- 
ts tive picture of the encoder and another predictive pic- 
ture of the low resolution decoder are reduced, such 
a situation is reduced that a picture does not exhibit 
smooth motion due to the loss of an interlace struc- 
ture. 

so Subsequently, processing of the selection circuit 

82 of Figure 7 will be described. 

Such 8x8 coefficient data supplied from the de- 
quantization circuit 82 as seen in Figure 4 are stored 
into the memory 92 of the selection circuit 83. When 

55 the predictive flag supplied from the variable length 
decoding circuit 71 represents the frame DCT mode, 
the address control circuit 91 reads out 4 x 4 data at 
the left upper corner and 1 x 4 data at the left lower 
corner of the table of Figure 4 and outputs the data 
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to the arithmetic circuit 90. The arithmetic circuit 90 
adds the four data d(7 ( 0), d(7, 1), d(7, 2) and d(7, 3) 
of the eighth row to the four data d(3, 0), d(3, 1), d(3, 
2) and d(3, 3) of the fourth row, respectively. As a re- 
sult, the 4 x 4 coefficients sampled out first and 
shown in Figure 12 are changed to 4 x 4 coefficients 
shown in Figure 13. In particular, while the coeffi- 
cients in the upper three rows in Figure 13 are the 
same as those in Figure 12, the data in the lowermost 
row are d(3, 0) + d(7, 0), d(3, 1) + d(7, 1), d(3, 2) + d(7 f 
2) and d(3, 3) + d(7, 3). The data are written into the 
memory 92. 

Four data corresponding to high frequency com- 
ponents arising from motion between fields of a same 
frame of an interlace picture are arranged at the four 
left data in the eighth row shown in Figure 4. Since 
the four data are added to the corresponding data in 
the fourth row which correspond to a highest frequen- 
cy in the low frequency region (4x4 data), if the 4 x 
4 coefficients (Figure 13) are read out from the ad- 
dress control circuit 91 and supplied to the IDCT cir- 
cuit 83 so as to be processed by IDCT processing, 
then the loss of an interlace structure which is caused 
by sampling out only 4x4 coefficient data at the left 
upper corner in the low frequency region from within 
8x8 DCT coefficient data while removing the other 
coefficient data is reduced, and a picture, which 
otherwise exhibits unnatural motion due to the loss of 
an interlace structure, is regenerated exhibiting 
smooth motion. 

While high frequency components arising from in- 
terlace are included in and around the lowermost row 
of 8 x 8 DCT coefficient data in the frame DCT mode, 
such components are not contained in the lowermost 
row of 8 x 8 DCT coefficients in the field DCT mode. 
Accordingly, although such processing as illustrated 
in Figure 13 is performed in the frame DCT mode, it 
is not performed in the field DCT mode. In this in- 
stance, the processing illustrated in Figure 12 is per- 
formed. 

Figure 14 illustrates another manner of process- 
ing of the selection circuit 82 in the frame DCT mode. 
In the present manner of processing, a sum D3 of ab- 
solute values of eight data d(3, 0) to d(3, 7) in the 
fourth row of Figure 4 is calculated by the arithmetic 
unit 90. Similarly, a sum D7 of absolute values of eight 
data d(7, 0) to d(7, 7) in the eighth row is calculated 
by the arithmetic unit 90. Further, the arithmetic unit 
90 compares the sums D3 and D7 with each other, 
and, if the sum D3 is greater than the sum D7, it se- 
lects the data d(3, 0) to d(3, 3) as the four data of the 
fourth row of the 4 x 4 coefficients, but on the con- 
trary if the sum D7 is greater than the sum D3, it se- 
lects the data d(7, 0) to d(7, 3). Figure 14 illustrates 
the condition in this instance. 

In particular, that the sum D3 is greater than the 
sum D7 means that the picture exhibits motion of a 
comparatively small amount between the two fields in 



the frame. Accordingly, in this instance, not the data 
d(7, 0) to d(7, 3) corresponding to high frequency 
components but the data d(3 f 0) to d(3, 3) corre- 

5 sponding to low frequency components are selected. 
On the contrary, when the sum D7 is greater than the 
sum D3, since the picture exhibits motion of a com- 
paratively great amount, the datad(7 ( 0) tod(7, 3) cor- 
responding to higher frequency components are'se- 

10 lected. 

Figure 15 illustrates a further manner of process- 
ing. In the present manner of processing, when the 
sum D3 described above is greater than the sum D7, 
such coefficients as shown in Figure 12 are selected 

15 as the 4x4 coefficients, but when the sum D7 is 
greater than the sum D3, four left side data d(6, 0) to 
d(6, 3) in the seventh row in Figure 4 and four left side 
data d(7, 0) to d(7, 3) in the eighth row are selected, 
and the 2 x 4 data are replaced with four left side data 

20 d(2, 0) to d(2, 3) in the third row and four left side data 
d(3 t 0) to d(3, 3) in the fourth row, respectively! In 
short, such 4x4 data as seen in Figure 15 are ob- 
tained. In the present manner of processing, higher 
frequency components are contained by a greater 

25 amount than in the manner of processing illustrated 
in Figure 14. 

It is to be noted that, when the predictive flag sup- 
plied from the variable length decoding circuit 71 in- 
dicates the frame predictive mode and the selection 

30 circuit 82 determines that the sum D3 is greater than 
the sum D7, motion compensation may be performed 
in the frame predictive mode (1), but when the s'um 
D7 is greater than the sum D3, motion compensation 
may be performed in the frame predictive mode (2). 

35 This is because, when the sum D3 is greater than the 
sum D7, since the picture exhibits motion of a small 
amount between the fields of the frame as described 
above, b' - (a 1 + c T )/2, and consequently, even if (a* + 
c')/2 is not produced by interpolation, a sufficient pre- 

40 dictive picture can be obtained. 

Subsequently, a method of zigzag scanning 
when such processing as described above is to be 
executed will be described. In order to realize the 
three manners of processing described above, it is 

45 possible, similarly as in the prior art, for the variable 
length coding circuit 58 of the encoder to scan 8x8 
coefficients in a zigzag pattern such that, for exam- 
ple, as shown in Figure 5, the scanning point first 
moves right wardly from the number 1 at the left upper 
so corner to the number 2 on the right side and then 
moves to the number 3 on the obliquely left lower side 
and then to the number 4 below the number 3, where- 
after it advances to the number 5 on the obliquely 
right upper side. However, if zigzag scanning is per- 

55 formed in such a manner as, for example, in Figure 
16, then data can be transmitted in a higher efficien- 
cy. 

In the manner of zigzag scanning illustrated in 
Figure 16, zigzag scanning is first performed within 
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the range of 4 x 4 coefficients at the left upper corner 
in 8 x 8 coefficients. In particular, the coefficient at 
the number 1 at the left upper corner is first transmit- 
ted, and then the coefficient at the number 2 on the 
right side to the number 1 is transmitted. Thereafter, 
the scanning point moves to the number 3 on the ob- 
liquely left lower side to the number 2, and then to the 
number 4 below the number 3, whereafter it moves to 
the number 5 on the obliquely right upper side to the 
number 4. The 16 coefficients are transmitted in a 
similar manner. Subsequently, four left side coeffi- 
cients of the numbers 17 to 20 in the eighth row are 
successively transmitted, and thereafter, four left 
side coefficients of the numbers 21 to 24 in the sev- 
enth row are successively transmitted beginning with 
v \the leftmost one. Then, after a total of 24 coefficients 
are transmitted in this manner, the scanning point ad- 
vances to the coefficient at the number 25 at the left- 
most position in the fifth row, and zigzag scanning is 
performed successively in the oblique direction ex- 
cept the coefficients which have been transmitted al- 
ready. 

The transmission by zigzag scanning is illustrated 
in a syntax diagram of Figure 17. Referring to Figure 
17, a quantization scale is transmitted first, and then 
a DCT coefficient which is indicated at the number 1 
V t in Figure 16 and represents a dc component is trans- 
■mitted. Subsequently, DCT coefficients of low fre- 
quencies indicated at the numbers 2 to 4 in Figure 16 
are transmitted successively. Then, after the 24 coef- 
ficients are transmitted, a signal EOB representative 
of the end of the block is sent out 

After the signal EOB is sent out a dequantization 
scale is sent out again. The first quantization scale in- 
dicates a quantization step which is used until the first 
EOB signal is sent out, and the second quantization 
scale indicates another quantization step which is 
used for coefficients to be transmitted later. After the 
H second quantization scale is sent out, the remaining 
coefficients of the numbers 25 to 64 in Figure 16 are 
successively transmitted in the order of the numbers. 
Then, after the 64th coefficient is transmitted, an- 
other EOB signal indicative of the end of the block is 
transmitted again. The EOB signals are generated by 
an EOB generator 58a built in the variable length cod- 
ing circuit 58 of Figure 1. 

If data are transmitted in such an order as descri- 
bed above, when the selection circuit 82 of the decod- 
er shown in Figure 6 receives the first EOB signal, it 
, may skip the coefficients which are transmitted there- 
to since then and then start its processing beginning 
with a coefficient transmitted immediately after the 
second EOB signal is thereafter transmitted thereto. 
On the other hand, in the high definition television 
signal system, the IDCT circuit 73 ignores the first 
EOB signal and detects the second EOB signal as an 
end signal of the block. 

While, in the foregoing description, a manner of 



processing is selected by the decoder side, it is other- 
wise possible for the encoder side to given an instruc- 
tion of processing. FIGS. 1 8 and 19 respectively show 
5 an encoder and a decoder constructed in a manner 
just described. In particular, in the encoder shown in 
Figure 18, a motion vector detection circuit 101 (the 
motion vector detection circuit 50 may serve also as 
the motion vector detection circuit 101) detects a mo- 
10 tion vector of a block from picture data for one f ield 
stored in a frame memory 51. The reason why a mo- 
tion vector is detected not from data for one frame but 
from data for one field is that it is intended to detect 
motion in interlace, that is, motion between an odd- 
15 numbered field and an even-numbered field. The mo- 
tion vector (motion information) detected by the mo- 
tion vector detection circuit 101 is supplied to a vari- 
able length coding circuit 58, from which it is transmit- 
ted as data of 1 bit or 2 bits and as a bit stream to the 
20 decoder side. 

On the decoder side, as shown in Figure 1 9, a va- 
riable length decoding circuit 71 detects the motion 
information transmitted thereto from the encoder side 
and controls a selection circuit 82 in accordance with 
25 the motion information. In particular, the selection cir- 
cuit 82 is constructed as shown, for example, in Fig- 
ure 20. Referring to Figure 20, the motion information 
supplied thereto from the variable length decoding 
circuit 71 is discriminated by a discrimination circuit 
30 111, and an address control circuit 91 is controlled in 
accordance with a result of the discrimination to con- 
trol data to be read out from the memory 92. 

Accordingly, in order to allow two of the manners 
of processing illustrated in FIGS. 13 to 15 to be exe- 
35 cuted, if a predetermined flag of one bit is transmitted 
from the encoder side, then two of the manners of 
processing illustrated in FIGS. 13 to 15 can be exe- 
cuted on the decoder side in response to the flag. 
Furthermore, if, for example, 2 bits are prepared 
40 for such motion information as described above, then 
a total of four kinds of data can be sent out. Therefore, 
motion can be divided into fourth types including a 
great amount of motion, a medium amount of motion, 
a small amount of motion and a stopping condition, 
45 and when the amount of motion is great, the process- 
ing illustrated in Figure 15 may be executed; when the 
amount of motion is medium, the processing illustrat- 
ed in Figure 14 may be executed; when the amount 
of motion is small, the processing illustrated in Figure 
so 13 may be executed; and when the picture is in a stop- 
ping condition, the processing illustrated in Figure 12 
may be executed. 

While, in the foregoing description, coefficient 
data of the fourth row or coefficient data of the third 
55 and fourth rows of 4 x 4 coefficient data are replaced 
by coefficient data of the eighth row or coefficient 
data of the seventh and eighth rows, respectively, at 
least one coefficient data may be replaced. Or on the 
contrary, the number of rows to be replaced may be 
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increased to three. 

Further, while data along a row or rows are re- 
placed in the foregoing description, data along a col- 
umn or columns may be replaced alternatively. 

Furthermore, while picture data are processed 
by DCT processing in the foregoing description, the 
present invention can be applied to any other ortho- 
gonal transformation than the DCT. 

Further, while, in the foregoing description, 8x8 
quantized data outputted from the quantization circuit 
57 are coded as they are into variable length codes 
and transmitted on the encoder side and, when a pic- 
ture of the standard television system is to be ob- 
tained, 4x4 data are sampled out on the decoder 
side, when 4 x4 quantized data on the low frequency 
side (at the left upper corner) are separated from the 
other quantized data and then the 4 x 4 quantized 
data and the other data are individually coded into va- 
riable length codes and transmitted on the encoder 
side, in order to obtain a picture of the standard tele- 
vision system, only the 4x4 quantized data on the low 
frequency side (at the left upper corner) may be de- 
coded as they are, but in order to obtain a picture of 
a full resolution, both of the 4x4 quantized data and 
the other data may be decoded by variable length de- 
coding into two kinds of quantized data, which are de- 
quantized subsequently. 

As apparent from the foregoing description, ac- 
cording to the present invention, when coefficient 
data of a particular range are sampled out from within 
a predetermined number of coefficient data and in- 
verse orthogonal transformation is to be performed 
for the thus sampled out coefficient data, the coeffi- 
cient data are processed so that they include those 
coefficient data which are not included in the partic- 
ular range. Further, motion compensation is per- 
formed in response to a predictive flag so that a pre- 
dictive picture and a parity of fields on the decoder 
side may coincide with those on the encoder side. 
Consequently, such a situation that smooth motion of 
the picture is disturbed by the loss of an interlace 
structure is eliminated or minimized. 

Having now fully described the invention, it will be 
apparent to one of ordinary skill in the art that many 
changes and modifications can be made thereto with- 
out departing from the scope of the invention as set 
forth herein. 



Claims 

1 . A picture signal decoding method comprising the 
steps of: 

sampling out from coefficient data of a first 
block formed by orthogonal transformation of 
picture element data, those of the coefficient 
data of a second block having a smaller range 
than the first block; 



replacing at least one of the coefficient 
data in the second block by a corresponding one 
or ones of the coefficient data in the first block 
5 but outside the second block; and 

performing inverse orthogonal transfor- 
mation for the coefficient data of the second 
block. 

10 2. A picture signal decoding method according to 
claim 1, wherein the first block includes m x n 
coefficient data while the second block includes 
j x k coefficient data, j being smaller t han m, k be- 
ing smaller than n, and the inverse orthogqnal 

15 transformation being performed for data ob- 

tained by replacing successive ones of the coef- 
ficient data of the j-N+1th row to the jth row in the 
second block by corresponding ones of the coef- 
ficient data of the m-N+1throwto the mth row in 

20 the corresponding columns of the first block, re- 
spectively, N being 1, 2, 3 j-1. 

3. A picture signal decoding method according to 
any one of claims 1 and 2, wherein the orthogo- 

25 nal transformation is a discrete cosine transform, 

and the inverse orthogonal transformation is^an 
inverse discrete cosine transform. 

4. A picture signal decoding method according to 
30 any one of claims 1, 2 or 3, wherein the picture 

element data are picture element data of a frame 
formed from two fields and having an interlace 
structure, and where the coefficient data of the 
first block are produced based on a difference 

35 from a predictive picture for which motion com- 

pensation has been performed in a frame predic- 
tive mode or a field predictive mode, motion com- 
pensation being performed in response to a pre- 
dictive mode of the first block to produce a pre- 

40 dictive picture for the second block. 

5. A picture signal decoding method according to 
claim 4, wherein, where the coefficient data of 
the first block are produced based on the differ- 

45 ence from the predictive picture for which the mo- 

tion compensation has been performed in the 
frame predictive mode, motion compensation for 
the second block is performed so that a field of 
picture elements of the predictive picture for ^he 

so second block may coincide with a corresponding 

field of picture elements of a predictive picture for 
the first block. 

6. A picture signal decoding method according to 
55 claim 5, wherein, when the picture elements of 

the predictive picture for the first block are pro- 
duced by interpolation upon the motion compen- 
sation, also corresponding picture elements of 
the predictive picture for the second block are 
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produced by interpolation. 

7. A picture element decoding method according to 
any one of claims 4 and 5, wherein, when picture 
elements corresponding to the picture elements 
of the predictive picture for the first block are 
present in the predictive picture for the second 
block upon the motion compensation, the picture 
elements are used for motion compensation. 

8. A picture signal decoding method according to 
any one of claims 4 and 5, wherein, where the 
coefficient data of the first block are produced 
based on the difference from the predictive pic- 
ture for which the motion compensation has been 
performed in the field predictive mode, motion 
compensation for the second block is performed 
so that the positions of the picture elements of 
the predictive picture for the second block may 
coincide with the positions of corresponding pic- 
ture elements of a predictive picture for the first 
block. 

9. A picture signal decoding method comprising the 
steps of: 

sampling out from coefficient data of a first 
block formed by orthogonal transformation of 
picture element data, those of the coefficient 
data of a second block having a smaller range 
than the first block; 

replacing at least one of the coefficient 
data in the second block by a sum or sums be- 
tween the at least one coefficient data in the sec- 
ond block and a corresponding one or ones of t he 
coefficient data in the first block but outside the 
second block; and 

performing inverse orthogonal transfor- 
mation for the coefficient data of the second 
block. 

10. A picture signal decoding method according to 
claim 9, wherein the first block includes m x n 
coefficient data while the second block includes 
j x k coefficient data, j being smaller than m, k be- 
ing smaller than n, and the inverse orthogonal 
transformation is performed for data obtained by 
replacing successive ones of the coefficient data 
in the jth row of the second block with a sum or 
sums between the coefficient data of the jth row 
in the second block and corresponding ones of 
the coefficient data in the mth row of the first 
block in the respective corresponding columns. 

11. A picture signal decoding method according to 
claim 9, wherein m is equal to n and j is equal to 
k. 

12. A picture signal decoding method according to 



claim 11, wherein m and n are equal to 8, and j 
and k are equal to 4. 

5 13. A picture signal decoding method according to 
any one of claims 9 to 12, wherein the orthogonal 
transformation is a discrete cosine transform, 
and the inverse orthogonal transformation is an 
inverse discrete cosine transform. 

w 

14. A picture signal decoding method according to 
any one of claims 9 to 13, wherein the picture ele- 
ment data are picture element data of a frame 
formed from two fields and having an interlace 

15 structure, and where the coefficient data of the 

first block are produced based on a difference 
from a predictive picture for which motion com- 
pensation has been performed in a frame predic- 
tive mode or afield predictive mode, motion com- 

20 pensation being performed in response to a pre- 

dictive mode of the first block to produce a pre- 
dictive picture for the second block. 

15. A picture signal decoding method according to 
25 claim 14, wherein, where the coefficient data of 

the first block are produced based on the differ- 
ence from the predictive picture for which the mo- 
tion compensation has been performed in the 
frame predictive mode, motion compensation for 
30 the second block is performed so that a field of 

picture elements of the predictive picture for the 
second block may coincide with a corresponding 
field of picture elements of a predictive picture for 
the first block. 

35 

16. A picture signal decoding method according to 
claim 15, wherein, when the picture elements of 
the predictive picture for the first block are pro- 
duced by interpolation upon the motion compen- 

40 sation, also corresponding picture elements of 

the predictive picture for the second block are 
produced by interpolation. 

17. A picture element decoding method according to 
45 any one of claims 14 and 15, wherein, when pic- 
ture elements corresponding to the picture ele- 
ments of the predictive picture for the first block 
are present in the predictive picture for the sec- 
ond block upon the motion compensation, the 

so picture elements are used for motion compensa- 

tion. 

18. A picture signal decoding method according to 
any one of claims 14 and 15, wherein, where the 

55 coefficient data of the first block are produced 

based on the difference from the predictive pic- 
ture for which the motion compensation has been 
performed in the field predictive mode, motion 
compensation for the second block is performed 
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so that the positions of the picture elements of 
the predictive picture for the second block may 
coincide with the positions of corresponding pic- 
ture elements of a predictive picture for the first 
block. 

19. A picture signal decoding method comprising the 
steps of; 

sampling out from m x n coefficient data of 
a first block formed by orthogonal transformation 
of picture element data of a frame formed from 
two fields and having an interlace structure, a 
second block including j x k coefficient data, j be- 
ing smaller than m and k being smaller than n; 

discriminating motion between the two 
fields of the first block; 

selecting, in response to a result of the dis- 
crimination, one of a first inverse orthogonal 
transformation mode in which the coefficient 
data of the second block are transformed as they 
are by inverse orthogonal transformation and a 
second inverse orthogonal transformation mode 
in which the inverse orthogonal transformation is 
performed for data obtained by replacing at least 
one of the coefficient data in the second block by 
a corresponding one or ones of the coefficient 
data in the first block but outside the second 
block; and 

- performing inverse orthogonal transfor- 
mation for the coefficient data of the second 
block. 

20. A picture signal decoding method according to 
claim 19, wherein m is equal to n and j is equal to 
k. 

21. A picture signal decoding method according to 
claim 20, wherein m and n are equal to 8, and j 
and k are equal to 4. 

22. A picture signal decoding method according to 
any one of claims 19 to 21, wherein the orthogo- 
nal transformation is a discrete cosine transform, 
and the inverse orthogonal transformation is an 
inverse discrete cosine transform. 

23. A picture signal decoding method comprising the 
steps of: 

sampling out from m x n coefficient data of 
a f irst block formed by orthogonal transformation 
of picture element data of a frame having an in- 
terlace structure formed from two fields, a sec- 
ond block including j x k coefficient data, j being 
smaller than m and k being smaller than n; 

discriminating motion between the two 
fields of the first block; 

selecting, in response to a result of the dis- 
crimination, one of a first inverse orthogonal 



transformation mode in which the coefficient 
data of the second block are transformed as they 
are by inverse orthogonal transformation and a 

5 second inverse transformation mode in which the 

inverse orthogonal transformation is perforrned 
for data obtained by replacing successive ones of 
the coefficient data of the j-N+1 th row to the jth 
row in the second block by corresponding ones 

10 of the coefficient data of the m-N+1th row to the 

mth row in the corresponding columns of the first 
block, respectively, N being 1, 2, 3, ... j-1; and 

performing inverse orthogonal transfor- 
mation for the coefficient data of the second 

15 block. 

24. A picture signal decoding method according to 
claim 23, wherein motion between the two fields 
is discriminated from a result of comparison be- 
20 tween an absolute value sum J of the coefficient 

data of the jth line in the first block and another 
absolute value sum M of the coefficient data of 
the mth row in the first block. 

25 25. A picture signal decoding method according to 
claim 24, wherein, where the m x n coefficient 
data of the first block are produced based on a 
difference from a predictive picture for which mo- 
tion compensation has been performed in a 

30 frame predictive mode, when the absolute value 

sum J is equal to or greater than the absolute val- 
ue sum M, a predictive picture for the second 
block is produced in a first frame predictive mode, 
but when the absolute value sum J is smaller than 

35 the absolute value sum M, a predictive picture for 

the second block is produced in a second frame 
predictive mode. 

26. A picture signal decoding method according to 
40 claim 24, wherein, when the absolute value sum 

J is equal to or greater than the absolute value 
sum M f the first inverse orthogonal transforma- 
tion mode is selected, but when the absolute val- 
ue J is smaller than the absolute value sum M r 
45 the second inverse orthogonal transformation 

mode wherein N is equal to 1 is selected. 

27. A picture signal decoding method according to 
claim 24, wherein, when the absolute value sum 

so J is equal to or greater than the absolute value 

sum M, the first inverse orthogonal transforma- 
tion mode is selected, but when the absolute val- 
ue J is smaller than the absolute value surrrM, 
the second inverse orthogonal transformation 

55 mode wherein N is equal to 2 is selected. 

28. A picture signal decoding method according to 
any one of claims 24 to 27, wherein m is equal to 
n and j is equal to k. 
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29. A picture signal decoding method according to 
any one of claims 24 to 27, wherein the orthogo- 
nal transformation is a discrete cosine transform, 
and the inverse orthogonal transformation is an 

^ inverse discrete cosine transform. 

30. A picture signal decoding method comprising the 
steps of: 

sampling out from m x n coefficient data of 
a first block formed by orthogonal transformation 
of picture element data of a frame formed from 
two fields and having an interlace structure, a 
second block including j x k coefficient data, j be- 
ing smaller than m, k being smaller than n; 

selecting, in accordance with information 
transmitted together with the coefficient data, 

% one of a first inverse orthogonal transformation 
mode in which the coefficient data of the second 
block are transformed as they are by inverse or- 
thogonal transformation and a second inverse 
orthogonal transformation mode in which the in- 
verse orthogonal transformation is performed for 
data obtained by replacing successive ones of 
the coefficient data of the j-N+1th to jth rows in 
the second block by corresponding ones of the 
coefficient data of the m-N+1th to mth rows in 
the corresponding columns, respectively, N be- 

^ ing 1,2, 3, ...,j-1;and 

performing inverse orthogonal transfor- 
mation for the coefficient data of the second 
block. 

31. A picture signal decoding method according to 
claim 30, wherein the information includes first 
motion information which represents a stopping 
condition and second motion information which 
represents some motion, and when the first mo- 
tion information is detected, the first inverse or- 
thogonal transformation mode is selected, but 

- i\ when the second motion information is detected, 
the second inverse orthogonal transformation 
mode wherein N is equal to 1 is selected. 

32. A picture signal decoding method according to 
claim 30, wherein the information includes first 
motion information which represents a stopping 
condition and second motion information which 
represents some motion, and when the first mo- 
tion information is detected, the first inverse or- 
thogonal transformation mode is selected, but 
when the second motion information is detected, 
the second inverse orthogonal transformation 
mode wherein N is equal to 2 is selected. 

33. A picture signal decoding method according to 
claim 30, wherein the information includes first 
motion information which represents a stopping 
condition, second motion information which rep- 



resents small motion, and third motion informa- 
tion which represents great motion, and when the 
first motion information is detected, the first in- 

5 verse orthogonal transformation mode is select- 

ed; when the second motion information is de- 
tected, the second inverse orthogonal transfor- 
mation mode wherein N is equal to 1 is selected; 
and when the third motion information is detect- 

10 ed, the second inverse orthogonal transforma- 

tion mode wherein N is equal to 2 is selected. 

34. A picture signal decoding method according to 
claim 30, wherein m is equal to n and j is equal to 

15 k. 

35. A picture signal decoding method according to 
daim 34, wherein m and n are equal to 8, and j 
and k are equal to 4. 

20 

36. A picture signal decoding method according to 
any one of claims 30 to 35, wherein the orthogo- 
nal transformation is a discrete cosine transform, 
and the inverse orthogonal transformation is an 

25 inverse discrete cosine transform. 

37. A picture signal coding apparatus, comprising: 

orthogonal transformation means for 
transforming picture element data of a frame 

30 formed from two fields and having an interlace 

structure by orthogonal transformation to form m 
x n coefficient data; 

quantization means for quantizing the 
coefficient data and outputting quantization data 

35 obtained by the quantization; and 

variable length coding means for coding 
the quantization data into variable length codes 
and successively transmitting the quantization 
data in the order of those coefficient data of a first 

40 quantization data group which correspond to j x 

k ones of the m x n coefficient data, j being small- 
er than m and k being smaller than n, those coef- 
ficient data of a second quantization data group 
which correspond to those of the m x n coeffi- 

45 cient data which belong to the m-N+1th to mth 

rows in the first to kth columns, N being 1 , 2, 3, .... 

and those coefficient data of a third quanti- 
zation data group which correspond to those of 
the m x n coefficient data which do not belong to 

so any of the first and second quantization data 

groups. 

38. A picture signal coding apparatus according to 
claim 37, wherein said variable length coding 

55 means includes means for adding end informa- 

tion to each of the second and third quantization 
data groups. 

39. A picture signal coding apparatus according to 

20 
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claim 37, wherein wherein m is equal to n and j is 
equal to k. 

40. A picture signal coding apparatus according to 5 
claim 39, wherein m and n are equal to 8, and j 

and k are equal to 4. 

41. A picture signal coding apparatus according to 
claim 37, wherein the orthogonal transformation 10 
is a discrete cosine transform. 

42. A picture signal coding apparatus, comprising: 

orthogonal transformation means for 
transforming picture element data of a frame 15 
formed from two fields and having an interlace 
structure by orthogonal transformation to form m 
x n coefficient data; 

motion detection means for detecting mo- 
tion between the two fields and outputting corre- 
sponding motion information; 

quantization means for quantizing the 
coefficient data and outputting quantization data 
obtained by the quantization; and 

variable length coding means for coding 
the motion information and the quantization data 
into variable length codes and outputting the va- 
riable length codes. 

43. A picture signal coding apparatus according to 
claim 42, wherein the quantization data are con- 
verted into variable length codes and succes- 
sively transmitted in the order of those coefficient 
data of a first quantization data group which cor- 
respond to j x k ones of the m x n coefficient data, 
j being smaller than m and k being smaller than 
n f those coefficient data of a second quantization 
data group which correspond to those of the m x 
n coefficient data which belong to the m-N+1th to 
mth rows in the first to kth columns, N being 1, 

2, 3 and those coefficient data of a third 

quantization data group which correspond to 
those of the m x n coefficient data which do not 
belong to any of the first and second quantization 
data groups. 

44. A picture signal coding apparatus according to 
claim 42, wherein said variable length coding 
means includes means for adding end informa- 
tion to each of the second and third quantization so 
data groups. 

45. A picture signal coding apparatus according to 
claim 42, wherein wherein m is equal to n and j is 
equal to k. 55 

46. A picture signal coding apparatus according to 
claim 45, wherein m and n are equal to 8, and j 
and k are equal to 4. 



47. A picture signal decoding apparatus wherein 
transmission picture element data of a frame 
formed from two fields and having an interlace 
structure are transformed by orthogonal trans- 
formation to form m x n coefficient data, and then 
the coefficient data are quantized and coded into 
variable length codes to decode the transmission 
data, comprising: 

variable length decoding means for de- 
coding the transmission data by variable length 
decoding to obtain decoded data and outputting 
the decoded data; 

dequantization means for dequantizing 
the decoded data to obtain coefficient data and 
outputting the coefficient data; 

sampling out means for sampling out, from 
the coefficient data, j x k coefficient data ob- 
tained by replacing successive ones of the coef- 



data are quantized and coded into variable length 
codes to decode the transmission data, compris- 
ing; 

variable length decoding means for de- 
coding the transmission data by variable length 
decoding to obtain decoded data and outputting 
the decoded data; 

dequantization means for dequantizing 
the decoded data to obtain coefficient data and 
outputting the coefficient data; 

motion discrimination means for discrimin- 
ating motion between the two fields in the first 
block; 

sampling out means responsive to a result 



20 f icient data of the jth row by sums of the succes- 

sive coefficient data of the jth row and corre- 
sponding ones of the coefficient data of the mth 
row in the corresponding columns, j being srrfall- 
er than m, k being smaller than n; and 
25 inverse orthogonal transformation means 

for transforming the j x k coefficient data sampled 
out by said sampling out means by inverse ortho- 
gonal transformation. 

30 48. A picture signal decoding apparatus according to 
claim 47, wherein m is equal to n and j is equal to 
k. 

49. A picture signal decoding apparatus according to 
35 claim 47 or 48, wherein the orthogonal transfor- 

mation is a discrete cosine transform, and the in- 
verse orthogonal transformation is an inverse 
discrete cosine transform. 

40 50. A picture signal decoding apparatus wherein 
transmission picture element data of a frame 
formed from two fields and having an interlace 
structure are transformed by orthogonal trans- 
formation to form m x n coefficient data which 
45 constitute a first block, and then the coefficient 
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of the discrimination by said motion discrimina- 
tion means for selectively sampling out first j x k 
ones of the coefficient data, j being smaller than 
m, k being smaller than n, or second j x k coeffi- 
cient data obtained by replacing successive ones 
of the coefficient data of the j-N+1th to jth rows 
by those of the coefficient data of the m-N+1th 
to mth rows in the corresponding columns, N be- 
ing 1, 2, 3, ...,j-1;and 

inverse orthogonal transformation means 
for transforming the j xk coefficient data sampled 
out by said sampling out means by inverse ortho- 
gonal transformation. 

51. A picture signal decoding apparatus according to 
claim 50, wherein said discrimination means in- 
cludes means for calculating an absolute value 
sum J of the coefficient data of the jth line, means 
for calculating another absolute value sum M of 
the coefficient data of the mth row in columns 
corresponding to those of the coefficient data of 
the jth row, and means for comparing the abso- 

v lute value sum J and the absolute value sum M 
with each other. 

52. A picture signal decoding apparatus according to 
claim 51, wherein said sampling out means se- 
lects the first coefficient data when the absolute 
value sum J is equal to or greater than the abso- 
lute value sum M, but selects the second coeffi- 
cient data wherein N is equal to 1 when the ab- 
solute value J is smaller than the absolute value 
sum M. 

■Si 53. A picture signal decoding apparatus according to 
claim 51, wherein said sampling out means se- 
lects the first coefficient data when the absolute 
value sum J is equal to or greater than the abso- 
lute value sum M, but selects the second coeffi- 
cient data wherein N is equal to 2 when the ab- 
solute value J is smaller than the absolute value 
sum M. 

54. A picture signal decoding apparatus according to 
claim 50, wherein said motion discrimination 
means includes motion information detection 
means for detecting motion information included 
in the transmission data. 

55. A picture signal decoding apparatus according to 
claim 54, wherein the information includes first 
motion information which represents a stopping 
condition and second motion information which 
represents some motion, and said sampling out 
means selects the first coefficient data when the 
first motion information is detected, but selects 
the second coefficient data wherein N is equal to 

':, 1 is selected when the second motion information 



is detected. 

56. A picture signal decoding apparatus according to 
5 claim 54, wherein the information includes first 

motion information which represents a stopping 
condition and second motion information which 
represents some motion, and said sampling out 
means selects the first coefficient data when the 
10 first motion information is detected, but selects 

the second coefficient data wherein N is equal to 
2 is selected when the second motion information 
is detected. 

15 57. A picture signal decoding apparatus according to 
claim 54, wherein the information includes first 
motion information which represents a stopping 
condition, second motion information which rep- 
resents small motion, and third motion informa- 

20 tion which represents great motion, and said sam- 

pling out means selects the first coefficient data 
when the first motion information is detected, but 
selects the second coefficient data wherein N is 
equal to 1 when the second motion information is 

25 detected, and otherwise selects the coefficient 

data wherein N is equal to 2 when the third motion 
information is detected. 

58. A picture signal decoding apparatus according to 
30 claim 50, wherein m is equal to n and j is equal to 

k. 

59. A picture signal decoding apparatus according to 
claim 58, wherein m and n are equal to 8, and j 

35 and k are equal to 4. 

60. A picture signal decoding apparatus according to 
any one of claims 50 to 59, wherein the orthogo- 
nal transformation is discrete cosine transform, 

40 and the inverse orthogonal transformation is in- 

verse discrete cosine transform. 

61. A picture signal coding method, comprising the 
steps of: 

45 transforming picture element data of a 

frame formed from two fields and having an inter- 
lace structure by orthogonal transformation to 
form m x n coefficient data; 

quantizing the coefficient data and output- 

50 ting quantization data obtained by the quantiza- 

tion; and 

coding the quantization data into variable 
length codes in the order of those coefficient 
data of a first quantization data group which cor- 
55 respond to j x k ones of the m x n coefficient data, 

j being smaller than m, k being smaller than n, 
those coefficient data of a second quantization 
data group which correspond to those of the m x 
n coefficient data which belong to the m-N+1th to 
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mth rows in the first to kth columns, N being 1, 

2, 3 j-1, and those coefficient data of a third 

quantization data group which correspond to 
those of the m x n coefficient data which do not 5 
belong to any of the first and second quantization 
data groups. 

62. A picture signal coding method according to claim 

61, wherein the quantization data after conver- 10 
sion into variable length codes are transmitted af- 
ter end information is added to each of the sec- 
ond and third quantization data groups. 

63. A picture signal coding method according toclaim is 
61 , wherein m is equal to n and j is equal to k. 

64. A picture signal coding method according to any 
one of claims 61 to 63, wherein the orthogonal 
transformation is a discrete cosine transform. 20 



68. A picture signal coding method according to claim 
65, wherein m is equal to n and j is equal to k. 

69. A picture signal coding method according to claim 
68, wherein m and n are equal to 8, and j and k 
are equal to 4. 

70. A picture signal coding method according to any 
one of claims 65 to 69, wherein the orthogonal 
transformation is a discrete cosine transform. 



65. A picture signal coding method, comprising the 
steps of: 

transforming picture element data of a 
frame formed from two fields and having an inter- 25 
lace structure by orthogonal transformation to 
form m x n coefficient data; 

detecting motion between the two fields 
and outputting corresponding motion informa- 
tion; 30 

quantizing the coefficient data and output- 
ting quantization data obtained by the quantiza- 
tion; and 

coding the motion information and the 
quantization data into variable length codes and 35 
transmitting the variable length codes. 

66. A picture signal coding method according to claim 
65, wherein the transmission of the quantization 
data after conversion into variable length codes 40 
is performed in the order of those coefficient 
data of a first quantization data group which cor- 
respond to j x k ones of the m x n coefficient data, 

j being smaller than m, k being smaller than n, 
those coefficient data of a second quantization 
data group which correspond to those of the m x 
n coefficient data which belong to the m-N+1th to 
mth rows in the first to kth columns, N being 1, 
2, 3, j-1 , and those coefficient data of a third 
quantization data group which correspond to 
those of the m x n coefficient data which do not 
belong to any of the first and second quantization 
data groups. 

67. A picture signal coding met hod according to claim ss 
65, wherein the quantization data after conver- 
sion into variable length codes are transmitted af- 
ter end information is added to each of the sec- 
ond and third quantization data groups. 
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